-- Logs begin at Mon 2022-01-31 16:21:16 UTC, end at Mon 2022-01-31 17:29:31 UTC. -- Jan 31 16:58:39.455025 dv-cinder-815660-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 31 16:58:39.462302 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 31 16:58:39.464656 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 16:58:39 2022] *** Jan 31 16:58:39.464840 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 16:58:39.464967 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 16:58:39.465059 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: nodename: dv-cinder-815660-5-iscsi Jan 31 16:58:39.465145 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: machine: x86_64 Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: clock source: unix Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: pcre jit disabled Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: detected number of CPU cores: 4 Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: current working directory: / Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: detected binary path: /usr/bin/uwsgi-core Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: your processes number limit is 47680 Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: your memory page size is 4096 bytes Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: detected max file descriptor number: 2048 Jan 31 16:58:39.465255 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: lock engine: pthread robust mutexes Jan 31 16:58:39.466016 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: thunder lock: enabled Jan 31 16:58:39.466016 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 31 16:58:39.466016 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 16:58:39.510642 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: Python main interpreter initialized at 0x56121a7dc9c0 Jan 31 16:58:39.510642 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: python threads support enabled Jan 31 16:58:39.510642 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: your server socket listen backlog is limited to 100 connections Jan 31 16:58:39.510642 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: your mercy for graceful operations on workers is 90 seconds Jan 31 16:58:39.511026 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 16:58:39.511026 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: *** Operational MODE: preforking *** Jan 31 16:58:39.511303 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: *** uWSGI is running in multiple interpreter mode *** Jan 31 16:58:39.511303 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: spawned uWSGI master process (pid: 102016) Jan 31 16:58:39.511501 dv-cinder-815660-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 31 16:58:39.512898 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: spawned uWSGI worker 1 (pid: 102017, cores: 1) Jan 31 16:58:39.512898 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: spawned uWSGI worker 2 (pid: 102018, cores: 1) Jan 31 16:58:39.512898 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 16:58:41.307941 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 16:58:41.307941 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: from cryptography.utils import int_from_bytes Jan 31 16:58:41.308814 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 16:58:41.308814 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: from cryptography.utils import int_from_bytes Jan 31 16:58:41.316239 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 16:58:41.316239 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: from cryptography.utils import int_from_bytes Jan 31 16:58:41.316761 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 16:58:41.316761 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: from cryptography.utils import int_from_bytes Jan 31 16:58:43.944887 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 16:58:43.945514 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 16:58:43.945627 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 16:58:43.945878 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 16:58:43.946233 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 16:58:43.946318 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 16:58:43.946407 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 16:58:43.946588 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.946686 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 16:58:43.946918 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.947011 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 16:58:43.947215 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 16:58:43.947317 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.947546 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.947656 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.947878 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.948016 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.948213 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.948414 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.948541 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.948767 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.948853 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.949237 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.949387 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.949578 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.949791 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.949934 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.950117 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.950303 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.950451 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-5-iscsi {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.950664 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.950779 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.950934 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.951093 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.951261 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.951408 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.951597 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-5-iscsi {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.951731 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.951970 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.952062 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.952342 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.952455 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.952699 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.952791 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.953044 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.953190 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.953384 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.953642 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.953776 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.953947 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.954114 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.954282 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.954588 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.954711 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.954903 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.954995 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.955216 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.955316 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.955539 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.955637 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.955850 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.955952 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.956200 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.956321 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.956514 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.956658 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.956914 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-5-iscsi {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957024 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957238 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957330 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957554 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957654 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957872 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.957973 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.958288 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-5-iscsi {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.958417 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.958598 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.958682 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.958908 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.958992 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.959232 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.959415 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.959559 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.959651 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.959870 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.959961 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.960224 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.960312 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.960552 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.960648 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.960875 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.960968 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.961199 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.961290 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.961505 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.961589 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.961817 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.961908 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.962131 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.962233 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.962458 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.962552 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.962766 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.962860 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963072 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963183 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963325 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963439 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963637 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963730 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.963963 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.964056 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.964310 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.964417 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.965096 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.965248 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.965419 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.965653 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.965746 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.965921 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966067 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966251 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966400 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966581 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966674 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966895 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.966980 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.967210 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.967305 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.967523 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.967608 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.967838 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.967921 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.968170 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.968271 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.968489 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.968578 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.968802 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.968886 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.969115 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.969198 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.969436 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.969521 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.969755 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.969838 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.970069 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.970152 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.970381 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.970465 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.970705 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.970795 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971033 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971132 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971344 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971439 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971657 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971740 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.971999 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.972095 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.972335 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.972421 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.972649 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.972740 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.972971 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.973072 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.973294 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.973377 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.973605 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.973698 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.973914 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974006 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974225 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974309 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974548 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974636 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974859 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.974942 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.975177 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.975260 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.975427 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.975519 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.975732 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.975838 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.976041 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.976176 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.976389 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.976472 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.976700 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.976829 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977008 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977098 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977318 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977402 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977624 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977707 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.977933 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978022 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978242 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978326 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978549 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978632 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978855 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.978937 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.979165 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.979256 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.979473 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.979556 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.979784 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.979867 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.980092 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.980287 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.981169 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.981265 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.981495 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.981703 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.981816 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982038 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982122 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982355 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982445 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982674 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982764 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.982987 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.983071 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.983300 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.983391 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.983627 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.983714 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.983940 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.984025 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.984280 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.984383 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.984610 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.984694 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.984923 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985014 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985233 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985360 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985556 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985641 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985867 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.985956 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.986179 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.986270 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.986496 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.986578 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.986799 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.986926 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.987110 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.987195 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.987426 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.987517 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.987733 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.987823 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988041 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988169 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988373 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988466 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988681 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988764 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.988988 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989072 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989296 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989391 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989602 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989685 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989909 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.989992 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.990212 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.990311 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.990522 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.990604 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.990834 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.990917 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.991143 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.991227 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.991453 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.991536 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.991760 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.991843 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.992082 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.992194 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.992420 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.992515 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.992750 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 16:58:43.992841 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.993094 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.993178 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.993412 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.993495 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.993746 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.993834 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.994079 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.994173 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.994400 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.994483 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.994713 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.994809 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.995029 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.995113 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.995361 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.995493 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.995678 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.995771 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.996066 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.996188 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.996498 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.996679 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.996826 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.997032 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.997145 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.997360 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.997466 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.997696 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.997788 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998019 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998111 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998341 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998432 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998664 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998748 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.998981 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.999065 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.999303 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.999387 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.999635 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.999726 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:43.999961 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.000089 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.000348 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.000432 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.000672 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.000768 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001024 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001108 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001343 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001460 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001672 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001788 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.001988 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.002084 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.002314 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.002409 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.002636 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.002739 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.002952 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.003046 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.003269 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.003363 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.003590 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.003707 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.003912 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004004 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004256 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004357 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004578 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004671 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004904 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.004987 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.005223 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.005308 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.005535 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.005633 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.005842 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.005926 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.006150 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.006233 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.006462 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.006546 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.006767 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.006859 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.007087 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.007242 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.007414 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.007542 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.007724 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.007862 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.008344 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.008487 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.008654 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.008781 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.008968 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.009096 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.009281 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.009417 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.009594 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.009722 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.009904 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010042 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010216 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010418 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010557 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010688 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010820 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.010953 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.011135 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.011274 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.011497 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.011654 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.011817 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.012056 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.012220 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.012477 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.012604 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.012796 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.012924 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.013116 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.013251 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.013437 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.013564 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.013758 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.013870 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.014076 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.014171 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.014392 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.014476 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.014721 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.014806 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.015040 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.015137 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.015355 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.015438 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.015696 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.015793 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.016027 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.016134 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.016366 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.016451 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.016697 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.016777 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017024 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017117 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017347 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017439 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017656 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017743 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.017967 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.018059 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.018277 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.018370 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.018587 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.018672 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.018897 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019001 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019208 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019300 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019515 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019608 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019822 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.019914 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.020149 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.020240 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.020459 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.020557 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.020765 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.020850 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.021088 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.021173 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.021400 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.021495 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.021711 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.021794 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022017 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022100 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022325 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022423 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022673 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022758 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.022981 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.023071 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.023324 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.023416 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.023660 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.023746 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.023983 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.024067 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.024336 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.024424 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.024656 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.024750 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.024977 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.025060 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.025289 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.025380 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.025605 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.025696 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.025919 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026007 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026232 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026318 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026555 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026640 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026869 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.026965 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.027729 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.027884 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.028051 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.028330 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.028414 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.028611 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.028728 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.028929 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.029058 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.029255 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.029373 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.029563 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.029698 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.029882 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.030045 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.030224 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.030388 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.030558 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.030715 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.030876 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.031047 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.031202 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.031370 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.031516 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.031694 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.031832 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.032012 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.032165 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.032358 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.032482 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.032680 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.032800 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033007 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033113 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033334 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033420 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033654 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033739 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.033982 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.034067 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.034301 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.034386 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.034630 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.034714 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.034942 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035026 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035263 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035348 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035570 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035660 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035886 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.035979 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.036245 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.036331 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.036590 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.036674 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.036898 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037038 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037215 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037301 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037541 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037623 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037851 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.037952 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.038165 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.038250 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.038478 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.038563 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.038788 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.038880 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.039097 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.039189 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.039409 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.039498 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.039728 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.039813 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.040038 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.040159 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.040378 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.040484 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.040683 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.040770 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041001 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041086 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041313 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041400 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041620 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041713 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.041930 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.042021 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.042243 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.042328 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.042567 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.042688 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.043010 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.043131 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.043343 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.043587 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.043681 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.043920 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044013 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044258 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044358 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044572 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044658 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044900 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.044986 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.045217 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.045306 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.045528 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.045617 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.045835 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.045919 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.046145 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.046239 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.046493 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.046578 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.046806 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.046890 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.047111 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.047194 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.047433 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.047518 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.047748 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.047831 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.048059 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.048180 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.048405 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.048489 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.048721 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.048804 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049036 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049128 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049361 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049448 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049677 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049762 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.049991 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.050091 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.050306 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.050392 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.050620 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.050705 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.050937 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051029 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051249 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051354 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051571 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051655 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051879 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.051976 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.052221 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.052309 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.052537 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.052620 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.052848 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.052935 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.053162 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.053253 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.053482 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.053738 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.054050 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.054137 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.054385 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.054479 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.054702 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.054787 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.055024 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.055109 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.055347 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.055432 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.055668 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.055784 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056002 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056088 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056358 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056454 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056674 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056767 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.056986 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.057080 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.057295 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.057381 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.057600 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.057693 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.057909 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.058041 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.058221 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.058832 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.059069 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.059221 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.059472 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.059635 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.059821 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.059949 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.060160 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.060306 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.060510 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.060620 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.060831 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.060925 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.061149 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.061243 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.061475 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.061571 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.061793 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.061878 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.062115 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.062199 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.062428 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.062524 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.062742 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.062827 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063067 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063156 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063378 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063462 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063688 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063772 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.063997 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.064081 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.064330 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.064422 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.064677 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.064762 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.064985 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.065075 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.065327 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.065421 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.065659 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.065744 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.065975 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.066132 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.066291 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.066386 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.066598 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.066681 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.066922 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067018 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067227 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067355 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067536 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067620 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067839 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.067934 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.068176 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.068264 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.068491 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.068586 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.068801 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.068898 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.069117 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.069201 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.069428 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.069511 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.069743 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.069843 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070049 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070134 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070351 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070434 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070665 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070749 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.070969 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071054 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071288 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071372 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071595 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071680 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071899 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.071993 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.072229 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.072316 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.072544 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.072629 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.072857 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.072947 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.073166 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.073312 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.073473 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.073558 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.073775 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.073858 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.074202 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.074302 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.074642 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.074762 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.074957 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.075108 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.075277 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.075420 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.075595 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.075737 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.075908 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.076050 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.076278 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.076376 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.076602 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.076687 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.076918 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077009 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077234 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077327 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077554 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077647 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077866 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.077950 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.078172 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.078256 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.078479 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.078563 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.078793 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.078877 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.079115 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.079199 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.079427 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.079513 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.079733 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.079828 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080044 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080162 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080378 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080474 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080685 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080778 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.080992 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081077 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081299 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081390 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081598 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081695 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081901 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.081986 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.082207 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.082296 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.082513 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.082609 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.082823 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.082908 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.083146 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.083230 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.083452 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.083544 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.083758 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.083850 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.084066 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.084213 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.084396 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.084482 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.084741 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.084833 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.085046 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.085136 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.085405 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.085491 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.085712 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.085796 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086030 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086113 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086349 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086433 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086662 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086746 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.086980 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087064 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087293 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087377 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087597 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087688 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087912 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.087996 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.088252 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.088342 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.088567 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.088650 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.088871 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.088963 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.089178 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.089263 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.090038 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.090171 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.090406 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.090580 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.090740 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.091075 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.091159 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.091406 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.091489 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.091717 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.091808 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.092036 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.092135 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.092376 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.092459 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.092697 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.092783 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093010 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093099 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093323 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093415 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093636 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093721 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.093949 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094035 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094264 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094369 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094581 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094716 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094891 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.094975 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.095200 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.095293 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.095511 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.095595 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.095820 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.095905 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.096148 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.096318 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.096464 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.096548 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.096773 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.096857 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.097090 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.097174 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.097397 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.097488 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.097707 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.097800 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098017 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098109 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098326 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098454 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098637 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098766 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.098946 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.099091 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.099374 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.099465 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.099691 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.099782 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100018 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100228 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100364 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100449 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100674 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100767 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.100990 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.101075 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.101301 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.101384 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.101613 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.101730 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.101919 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.102054 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.102341 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.102433 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.102664 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.102762 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.102979 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103063 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103294 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103387 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103603 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103696 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103908 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.103999 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.104249 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.104367 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.104578 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.104704 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.104887 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.105018 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.105307 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.105475 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.105797 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.105882 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.106243 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.106334 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.106576 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.106696 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.106906 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.107045 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.107330 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.107416 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.107649 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.107853 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.107951 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.108244 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.108398 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.108614 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.108701 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.108972 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.109065 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.109320 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.109404 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.109646 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.109732 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.109971 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.110057 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.110281 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.110407 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.110597 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.110682 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.110910 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.111037 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.111238 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.111397 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.111565 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.111721 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.111880 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.112048 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.112223 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.112414 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.112538 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.112798 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.112885 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.113167 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.113252 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.113480 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.113563 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.113806 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.113892 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.114223 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.114327 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.114551 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.114637 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.114866 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.114952 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.115192 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.115278 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.115522 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.115607 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.115826 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.115916 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.116156 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.116246 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.116472 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.116567 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.116782 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.116867 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.117090 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.117175 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.117413 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.117499 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.117722 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.117860 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118033 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118117 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118346 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118430 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118658 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118764 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.118963 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119049 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119269 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119353 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119590 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119686 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119899 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.119984 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.120250 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.120347 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.120568 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.120665 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.121476 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.121566 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.121861 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122048 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122169 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122258 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122525 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122611 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122886 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.122970 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.123192 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.123277 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.123502 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.123588 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.123812 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.123897 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.124184 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.124286 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.124497 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.124612 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.124821 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.124947 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.125154 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.125313 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.125485 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.125696 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.125801 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.126020 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.126137 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.126366 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.126452 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.126704 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.126788 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127029 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127115 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127359 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127450 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127679 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127763 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.127987 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.128072 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.128323 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.128419 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.128646 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.128778 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.128939 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129026 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129247 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129338 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129557 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129649 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129860 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.129944 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.130166 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.130258 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.130475 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.130602 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.130788 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.130874 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.131092 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.131176 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.131416 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.131511 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.131729 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.131821 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.132037 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.132148 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.132372 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.132471 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.132684 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.132770 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.133257 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.133347 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.133591 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.133677 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.133908 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.133992 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.134234 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.134317 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.134560 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.134647 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.134888 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.134973 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.135199 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.135291 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.135525 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.135647 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.135847 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.135931 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.136193 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.136292 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.136563 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.136702 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.136898 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.137138 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.137225 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.137468 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.137554 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.137792 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.137878 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.138118 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.138212 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.138435 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.138535 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.138760 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.138892 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.139083 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.139177 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.139406 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.139491 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.139929 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.140035 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.140291 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.140390 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.140647 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.140746 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.140925 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141018 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141244 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141341 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141560 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141646 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141880 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.141965 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.142197 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.142297 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.142514 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.142599 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.142827 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.142912 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.143144 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.143238 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.143476 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.143570 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.143800 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.143886 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.144157 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.144248 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.144489 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.144573 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.144812 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.144907 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.145130 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.145223 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.145452 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.145544 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.145772 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.145858 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.146133 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.146230 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.146451 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.146537 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.146760 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.146853 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.147079 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.147172 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.147400 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.147515 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.147719 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.147865 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.148036 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.148257 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.148378 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.148604 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.148709 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.148968 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.149054 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.149307 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.149391 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.149620 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.149715 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.149939 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.150024 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.150256 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.150343 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.150583 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.150701 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.150921 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151010 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151247 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151334 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151566 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151653 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151885 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.151978 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.152811 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.153009 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.153368 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.153649 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.153902 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.153988 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.154228 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.154320 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.154571 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.154659 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.154911 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155003 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155244 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155336 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155565 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155658 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155893 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.155985 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.156227 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.156330 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.156541 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.156634 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.156858 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.156951 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.157169 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.157262 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.157479 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.157565 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.157790 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.157874 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.158105 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.158198 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.158417 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.158519 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.158726 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.158811 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.159037 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.159123 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.159357 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.159572 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.159897 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.159982 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.160252 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.160340 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.160585 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.160670 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.160916 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.161015 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.161235 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.161348 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.161546 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.161685 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.161875 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.162034 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.162187 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.162392 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.162502 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.162739 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.162823 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.163095 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.163182 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.163417 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.163508 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.163727 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.163813 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.164040 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.164146 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.164377 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.164462 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.164688 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.164785 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165004 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165091 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165311 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165445 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165641 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165726 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.165950 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166036 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166258 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166350 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166566 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166659 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166880 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.166965 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.167189 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.167286 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.167496 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.167590 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.167957 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.168044 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.168306 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.168575 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.168662 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.168918 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169012 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169217 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169312 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169527 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169619 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169834 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.169920 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.170146 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.170230 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.170455 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.170548 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.170765 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.170850 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171070 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171160 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171379 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171473 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171692 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171776 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.171999 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.172092 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.172336 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.172431 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.172654 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.172738 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.172973 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.173057 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.173285 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.173388 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.173600 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.173685 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.173918 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.174002 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.174257 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.174349 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.174582 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.174831 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.175168 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.175253 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.175488 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.175573 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.175825 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.175911 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.176190 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.176280 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.176507 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.176596 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.176817 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.176910 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.177128 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.177214 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.177441 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.177526 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.177753 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.177837 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.178067 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.178161 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.178379 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.178514 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.178692 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.178779 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179004 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179102 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179319 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179420 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179629 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179724 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.179941 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180037 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180279 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180377 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180593 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180680 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180907 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.180993 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.181222 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.181321 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.181541 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.181636 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.181867 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.181953 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.182184 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.182277 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.182508 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.182594 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.182828 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.182923 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.183141 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.183227 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.183992 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.184194 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.184340 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.184572 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.184658 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.184891 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.184977 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.185214 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.185312 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.185548 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.185635 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.185867 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.185960 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.186179 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.186266 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.186602 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.186689 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.186919 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187013 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187241 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187327 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187563 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187648 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187874 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.187967 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.188230 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.188318 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.188557 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.188653 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.188871 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.188966 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.189196 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.189283 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.189513 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.189617 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.189844 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.189942 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.190185 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.190270 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.190515 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.190599 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.190842 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.190929 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.191149 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.191251 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.191457 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.191555 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.191765 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.191852 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.192073 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.192186 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.192436 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.192523 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.192771 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.192858 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.193091 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.193210 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.193415 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.193532 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.193733 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.193890 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.194058 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.194220 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.194371 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.194468 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.194695 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.194780 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195062 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195155 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195336 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195433 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195647 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195766 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.195976 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.196126 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.196320 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.196453 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.196636 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.196774 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.196948 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.197096 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.197263 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.197419 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.197576 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.197738 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.197887 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.198059 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.198216 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.198397 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.198546 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.198735 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.198889 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.199208 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.199351 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.199558 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.199903 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.199989 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.200259 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.200362 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.200586 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.200681 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.200905 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.200990 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.201239 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.201338 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.201554 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.201649 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.201877 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.201964 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.202192 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.202287 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.202511 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.202597 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.202831 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.202918 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.203151 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.203244 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.203480 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.203566 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.203811 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.203898 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.204166 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.204253 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.204497 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.204596 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.204848 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.204936 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.205165 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.205252 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.205510 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.205595 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.205839 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.205934 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.206155 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.206241 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.206469 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.206554 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.206776 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.206869 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 16:58:44.207019 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 16:58:44.207106 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 16:58:44.230068 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.231774 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_db.sqlalchemy.engines [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.294151 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.context [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd739326-28c2-4c93-a99b-2c85f99964f9(cell1) {{(pid=102018) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 16:58:44.295501 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.context [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd739326-28c2-4c93-a99b-2c85f99964f9(cell1) {{(pid=102017) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 16:58:44.298393 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 16:58:44.299690 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_concurrency.lockutils [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 16:58:44.299969 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 16:58:44.300810 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 16:58:44.301345 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_concurrency.lockutils [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 16:58:44.302156 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_concurrency.lockutils [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 16:58:44.302717 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 16:58:44.304138 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_concurrency.lockutils [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 16:58:44.317179 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.318589 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.321011 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_db.sqlalchemy.engines [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.323959 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_db.sqlalchemy.engines [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.484584 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG oslo_db.sqlalchemy.engines [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.491472 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_db.sqlalchemy.engines [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 16:58:44.828040 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: WARNING keystonemiddleware.auth_token [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 16:58:44.832793 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: WARNING keystonemiddleware.auth_token [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 16:58:44.834505 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: WARNING keystonemiddleware.auth_token [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 16:58:44.839305 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: WARNING keystonemiddleware.auth_token [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 16:58:45.177981 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: WARNING keystonemiddleware.auth_token [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 16:58:45.181804 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: WARNING keystonemiddleware.auth_token [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 16:58:45.183100 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: WARNING keystonemiddleware.auth_token [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 16:58:45.187166 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: WARNING keystonemiddleware.auth_token [None req-9ee5ca3d-e8d3-41fa-9c23-274eeda57452 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 16:58:45.188608 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56121a7dc9c0 pid: 102017 (default app) Jan 31 16:58:45.190664 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 16:58:45.191834 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] 10.222.0.91 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jan 31 16:58:45.192275 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 788 bytes} [Mon Jan 31 16:58:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 16:58:45.192454 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56121a7dc9c0 pid: 102018 (default app) Jan 31 17:00:10.931996 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:10.933159 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Jan 31 17:00:10.933741 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 2/2] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:11.353067 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-10cbb64e-c723-4b8f-88c4-6e6dc41366be admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:11.381782 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-10cbb64e-c723-4b8f-88c4-6e6dc41366be admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.441133 Jan 31 17:00:11.383206 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 1/3] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Jan 31 17:00:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:13.666587 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:13.667578 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-735695a3-8bd0-43e0-9e29-9af2b2d763f6 None None] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jan 31 17:00:13.667988 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 3/4] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:00:13.727235 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-b5fd40da-7cb2-4a07-9d86-ae47296258e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:13.746224 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:00:13.746224 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: warnings.warn(msg) Jan 31 17:00:13.776823 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-b5fd40da-7cb2-4a07-9d86-ae47296258e6 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102817 Jan 31 17:00:13.777551 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 2/5] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:13.998184 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-bf12e435-3db7-432a-8970-e5b71588bc4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:14.000685 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:00:14.000685 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: warnings.warn(msg) Jan 31 17:00:14.048346 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-bf12e435-3db7-432a-8970-e5b71588bc4c admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262646 Jan 31 17:00:14.049068 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 4/6] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Jan 31 17:00:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:16.473526 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-b5fd40da-7cb2-4a07-9d86-ae47296258e6 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:16.474542 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-b5fd40da-7cb2-4a07-9d86-ae47296258e6 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 31 17:00:16.474953 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 3/7] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:16.577580 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-5d712383-9326-4902-8a4c-f68a2b39b330 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "ram": 512, "vcpus": 1}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:16.595630 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:00:16.595630 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: warnings.warn(msg) Jan 31 17:00:16.614454 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-5d712383-9326-4902-8a4c-f68a2b39b330 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133624 Jan 31 17:00:16.615015 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 5/8] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:16.626881 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-2b1adfdb-8770-4893-ac32-60be22fdcd21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:16.628481 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:00:16.628481 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: warnings.warn(msg) Jan 31 17:00:16.661390 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-2b1adfdb-8770-4893-ac32-60be22fdcd21 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038297 Jan 31 17:00:16.661965 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 4/9] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Jan 31 17:00:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:18.969654 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-5d712383-9326-4902-8a4c-f68a2b39b330 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:18.970735 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-5d712383-9326-4902-8a4c-f68a2b39b330 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jan 31 17:00:18.971172 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 6/10] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:00:19.030204 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-b5d76fa6-b198-4a12-87a1-aeff70fb6494 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "swap": 0}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:19.051443 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-b5d76fa6-b198-4a12-87a1-aeff70fb6494 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073183 Jan 31 17:00:19.052931 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 5/11] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:19.064636 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-fed1e04c-7a46-438d-b17d-f827c2e9014b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:19.091958 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-fed1e04c-7a46-438d-b17d-f827c2e9014b admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030977 Jan 31 17:00:19.092575 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 7/12] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Jan 31 17:00:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:00:21.407031 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-b5d76fa6-b198-4a12-87a1-aeff70fb6494 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:21.408489 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-b5d76fa6-b198-4a12-87a1-aeff70fb6494 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 31 17:00:21.408489 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 6/13] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:21.470113 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-1f2b2a93-7d17-4a0e-879f-21f16d2fae39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:21.488499 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-1f2b2a93-7d17-4a0e-879f-21f16d2fae39 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073807 Jan 31 17:00:21.489063 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 8/14] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:21.501667 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-489b57c9-3b40-4b8c-b9a6-28af95a8c275 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:21.525177 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-489b57c9-3b40-4b8c-b9a6-28af95a8c275 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027158 Jan 31 17:00:21.525770 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 7/15] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Jan 31 17:00:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:23.813247 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-1f2b2a93-7d17-4a0e-879f-21f16d2fae39 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:23.814263 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-1f2b2a93-7d17-4a0e-879f-21f16d2fae39 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 31 17:00:23.814700 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 9/16] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:23.878035 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-6e432b06-c712-4719-aa40-1ca897eeee91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:23.896420 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-6e432b06-c712-4719-aa40-1ca897eeee91 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075675 Jan 31 17:00:23.897902 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 8/17] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:23.910230 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-8c8defec-e503-440f-b16e-c64595151c50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:23.935236 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-8c8defec-e503-440f-b16e-c64595151c50 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028851 Jan 31 17:00:23.935935 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 10/18] 10.222.0.91 () {64 vars in 1335 bytes} [Mon Jan 31 17:00:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:26.260747 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-6e432b06-c712-4719-aa40-1ca897eeee91 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:26.261777 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-6e432b06-c712-4719-aa40-1ca897eeee91 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jan 31 17:00:26.262249 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 9/19] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:26.326144 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-58c2cfa7-ca0d-467c-b619-810c706f86be admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:26.349161 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-58c2cfa7-ca0d-467c-b619-810c706f86be admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080749 Jan 31 17:00:26.349874 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 11/20] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Jan 31 17:00:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:00:28.699908 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-6e432b06-c712-4719-aa40-1ca897eeee91 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:28.701044 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-6e432b06-c712-4719-aa40-1ca897eeee91 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jan 31 17:00:28.701475 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 10/21] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:28.764554 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-077604ec-249d-4dfd-9164-89190fe10093 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:28.785597 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-077604ec-249d-4dfd-9164-89190fe10093 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078171 Jan 31 17:00:28.786526 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 12/22] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:28.799457 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-110d978d-728e-4c29-8775-cc0e0e004838 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:28.822908 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-110d978d-728e-4c29-8775-cc0e0e004838 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027111 Jan 31 17:00:28.823666 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 11/23] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Jan 31 17:00:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:31.096190 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-077604ec-249d-4dfd-9164-89190fe10093 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:31.097213 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-077604ec-249d-4dfd-9164-89190fe10093 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jan 31 17:00:31.097618 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 13/24] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:31.157439 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0179ed31-16fc-4cd2-b9f7-d4ac50f9dacd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "swap": 0, "disk": 20}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:31.175763 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0179ed31-16fc-4cd2-b9f7-d4ac50f9dacd admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072128 Jan 31 17:00:31.176354 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 12/25] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:00:31.188889 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-750930cc-5759-40ba-8fa5-98ac909e2ea0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:31.211748 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-750930cc-5759-40ba-8fa5-98ac909e2ea0 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026473 Jan 31 17:00:31.212364 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 14/26] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Jan 31 17:00:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:33.476374 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0179ed31-16fc-4cd2-b9f7-d4ac50f9dacd admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:33.477395 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0179ed31-16fc-4cd2-b9f7-d4ac50f9dacd admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jan 31 17:00:33.477803 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 13/27] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:00:33.537637 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-2dd990fc-daa3-4e58-b392-a554a0e59638 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:33.556527 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-2dd990fc-daa3-4e58-b392-a554a0e59638 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072950 Jan 31 17:00:33.557091 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 15/28] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:00:33.570001 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-8717e39f-85d9-40e6-884f-8696fe31a0ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:33.592845 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-8717e39f-85d9-40e6-884f-8696fe31a0ed admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027255 Jan 31 17:00:33.593425 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 14/29] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Jan 31 17:00:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:00:35.861352 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-2dd990fc-daa3-4e58-b392-a554a0e59638 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:35.862356 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-2dd990fc-daa3-4e58-b392-a554a0e59638 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jan 31 17:00:35.862765 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 16/30] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:35.919151 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-157c33f2-6f74-4a92-bfae-fc0e72524d1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "vcpus": 4, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:35.937022 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-157c33f2-6f74-4a92-bfae-fc0e72524d1e admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.067842 Jan 31 17:00:35.937758 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 15/31] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:00:35.949450 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-c98d7bc7-532e-438b-b6f9-1380fbd9d773 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:35.973197 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-c98d7bc7-532e-438b-b6f9-1380fbd9d773 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027488 Jan 31 17:00:35.973779 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 17/32] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Jan 31 17:00:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:00:38.267688 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-157c33f2-6f74-4a92-bfae-fc0e72524d1e admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:00:38.268785 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-157c33f2-6f74-4a92-bfae-fc0e72524d1e admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jan 31 17:00:38.269195 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 16/33] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:00:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:00:38.336434 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-2dd6cab7-3e5b-488c-8049-990337df2598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "id": "5", "disk": 160, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:38.355445 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-2dd6cab7-3e5b-488c-8049-990337df2598 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080121 Jan 31 17:00:38.356679 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 18/34] 10.222.0.91 () {64 vars in 1282 bytes} [Mon Jan 31 17:00:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:00:38.369811 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-6a7d31f1-6f57-4128-b6bd-1b5a41b4391a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:00:38.395939 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-6a7d31f1-6f57-4128-b6bd-1b5a41b4391a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031582 Jan 31 17:00:38.396753 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 17/35] 10.222.0.91 () {64 vars in 1332 bytes} [Mon Jan 31 17:00:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:01:02.200458 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-2dd6cab7-3e5b-488c-8049-990337df2598 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:02.201463 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-2dd6cab7-3e5b-488c-8049-990337df2598 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jan 31 17:01:02.201861 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 19/36] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:02.259039 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-55a59808-6f76-448b-a287-f5b80256578a admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:02.276602 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-55a59808-6f76-448b-a287-f5b80256578a admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068627 Jan 31 17:01:02.277131 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 18/37] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Jan 31 17:01:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:01:03.651431 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-2dd6cab7-3e5b-488c-8049-990337df2598 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:03.652479 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-2dd6cab7-3e5b-488c-8049-990337df2598 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jan 31 17:01:03.652879 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 20/38] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:03.847612 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-777170cc-01d3-4a2b-b37c-6c8c870e6a02 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:03.853165 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.wsgi [None req-777170cc-01d3-4a2b-b37c-6c8c870e6a02 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 31 17:01:03.853739 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-777170cc-01d3-4a2b-b37c-6c8c870e6a02 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:01:03.854540 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-777170cc-01d3-4a2b-b37c-6c8c870e6a02 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058344 Jan 31 17:01:03.855052 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 19/39] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Jan 31 17:01:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 17:01:03.864327 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-6297dd2a-7001-46fd-8ccb-d01d48b06d17 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:03.885653 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-6297dd2a-7001-46fd-8ccb-d01d48b06d17 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024887 Jan 31 17:01:03.886186 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 21/40] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Jan 31 17:01:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:01:03.895357 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-30bcf058-9af8-45be-816e-d1cd9f84a32a admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:03.917070 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-30bcf058-9af8-45be-816e-d1cd9f84a32a admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025090 Jan 31 17:01:03.917604 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 20/41] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Jan 31 17:01:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:01:03.926731 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-4c03b8d0-3d4a-4a23-abe9-2d8237977425 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:03.932506 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.wsgi [None req-4c03b8d0-3d4a-4a23-abe9-2d8237977425 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 31 17:01:03.933062 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-4c03b8d0-3d4a-4a23-abe9-2d8237977425 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:01:03.933846 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-4c03b8d0-3d4a-4a23-abe9-2d8237977425 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010582 Jan 31 17:01:03.934329 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 22/42] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Jan 31 17:01:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 17:01:05.251900 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-30bcf058-9af8-45be-816e-d1cd9f84a32a admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:05.252954 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-30bcf058-9af8-45be-816e-d1cd9f84a32a admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jan 31 17:01:05.253346 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 21/43] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:05.446321 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-8967a6c3-fcd5-4598-b07e-f68f4d12aa27 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:05.452013 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.wsgi [None req-8967a6c3-fcd5-4598-b07e-f68f4d12aa27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 31 17:01:05.452613 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-8967a6c3-fcd5-4598-b07e-f68f4d12aa27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:01:05.453405 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-8967a6c3-fcd5-4598-b07e-f68f4d12aa27 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058326 Jan 31 17:01:05.453900 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 23/44] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Jan 31 17:01:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 17:01:05.463208 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-564117f6-142b-4d0f-99a9-d1c662d3f0df admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:05.476960 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-564117f6-142b-4d0f-99a9-d1c662d3f0df admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017300 Jan 31 17:01:05.477497 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 22/45] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Jan 31 17:01:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:01:05.486592 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-9d0e25c5-08ba-49ac-8b9f-5d9e11860ca9 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:05.500621 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-9d0e25c5-08ba-49ac-8b9f-5d9e11860ca9 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017487 Jan 31 17:01:05.501136 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 24/46] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Jan 31 17:01:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:01:05.510292 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-8a072b34-94ef-44b7-ab0c-0136403e0fac admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:05.515356 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.wsgi [None req-8a072b34-94ef-44b7-ab0c-0136403e0fac admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 31 17:01:05.515906 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-8a072b34-94ef-44b7-ab0c-0136403e0fac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:01:05.516716 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-8a072b34-94ef-44b7-ab0c-0136403e0fac admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009865 Jan 31 17:01:05.517214 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 23/47] 10.222.0.91 () {60 vars in 1190 bytes} [Mon Jan 31 17:01:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 17:01:06.796039 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-9d0e25c5-08ba-49ac-8b9f-5d9e11860ca9 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:06.797083 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-9d0e25c5-08ba-49ac-8b9f-5d9e11860ca9 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jan 31 17:01:06.797483 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 25/48] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:06.992255 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-528fcd2d-dfc1-4b38-90c4-3223b593d49e admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:06.997360 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.wsgi [None req-528fcd2d-dfc1-4b38-90c4-3223b593d49e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 31 17:01:06.997929 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-528fcd2d-dfc1-4b38-90c4-3223b593d49e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:01:06.998714 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-528fcd2d-dfc1-4b38-90c4-3223b593d49e admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057948 Jan 31 17:01:06.999220 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 24/49] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Jan 31 17:01:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 31 17:01:07.009645 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-2864d4ff-ba27-412e-b055-a84cc1663881 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:07.023320 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-2864d4ff-ba27-412e-b055-a84cc1663881 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017955 Jan 31 17:01:07.023849 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 26/50] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Jan 31 17:01:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:01:07.033553 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:07.046953 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017307 Jan 31 17:01:07.047488 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 25/51] 10.222.0.91 () {60 vars in 1210 bytes} [Mon Jan 31 17:01:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:01:07.057332 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-56442ee6-a4ed-46de-a398-dbefdee13faf admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:07.062446 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.wsgi [None req-56442ee6-a4ed-46de-a398-dbefdee13faf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 31 17:01:07.063008 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-56442ee6-a4ed-46de-a398-dbefdee13faf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:01:07.063787 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-56442ee6-a4ed-46de-a398-dbefdee13faf admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009974 Jan 31 17:01:07.064315 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 27/52] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Jan 31 17:01:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 31 17:01:08.338747 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:08.339792 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 31 17:01:08.340238 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 26/53] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:08.535349 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-99eb69d4-01b7-488a-af82-802f8c170580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:01:08.555338 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-99eb69d4-01b7-488a-af82-802f8c170580 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072227 Jan 31 17:01:08.555810 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 28/54] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Jan 31 17:01:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:01:09.840231 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:09.841249 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jan 31 17:01:09.841650 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 27/55] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:10.035988 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-523340f4-c57e-4408-a30c-f5faef359a4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:01:10.054677 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-523340f4-c57e-4408-a30c-f5faef359a4a admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069950 Jan 31 17:01:10.055179 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 29/56] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Jan 31 17:01:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:01:11.324018 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:11.325090 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jan 31 17:01:11.325494 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 28/57] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:11.516045 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-4f3f2e47-952c-491a-9ad4-e75b45bb71f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:01:11.534594 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-4f3f2e47-952c-491a-9ad4-e75b45bb71f5 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068720 Jan 31 17:01:11.535063 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 30/58] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Jan 31 17:01:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:01:12.817438 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:12.818449 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jan 31 17:01:12.818848 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 29/59] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:13.012429 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-9698dcdd-aa88-4097-b805-8525d3cbe166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:01:13.029641 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-9698dcdd-aa88-4097-b805-8525d3cbe166 admin admin] 10.222.0.91 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069460 Jan 31 17:01:13.030139 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 31/60] 10.222.0.91 () {64 vars in 1235 bytes} [Mon Jan 31 17:01:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:01:14.332460 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:14.333518 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jan 31 17:01:14.333968 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 30/61] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:01:14.528820 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-7a67b6e4-abfb-4020-9d9c-ce3db04a09d9 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:01:14.548318 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-7a67b6e4-abfb-4020-9d9c-ce3db04a09d9 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073151 Jan 31 17:01:14.548844 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 32/62] 10.222.0.91 () {60 vars in 1202 bytes} [Mon Jan 31 17:01:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:02:00.514824 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:02:00.515848 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0c6c30df-766a-4912-a24d-ece8ed384ec1 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 31 17:02:00.516302 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 31/63] 10.222.0.91 () {54 vars in 930 bytes} [Mon Jan 31 17:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:02:00.574284 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-3210768c-9322-4f06-b7b0-021b1aed531c admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:02:00.594840 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-3210768c-9322-4f06-b7b0-021b1aed531c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071817 Jan 31 17:02:00.594840 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 33/64] 10.222.0.91 () {60 vars in 1291 bytes} [Mon Jan 31 17:02:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:02:00.617264 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-5a4f9593-157d-4ec7-a687-06bc361fdd8c admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:02:00.624901 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-5a4f9593-157d-4ec7-a687-06bc361fdd8c admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011897 Jan 31 17:02:00.625432 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 32/65] 10.222.0.91 () {60 vars in 1282 bytes} [Mon Jan 31 17:02:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:02:00.637261 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-1c01cfaa-cf19-446a-97eb-909abcd01605 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:02:00.644827 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-1c01cfaa-cf19-446a-97eb-909abcd01605 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011108 Jan 31 17:02:00.645339 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 34/66] 10.222.0.91 () {60 vars in 1285 bytes} [Mon Jan 31 17:02:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:02:00.656449 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-fd6dfe68-ddb2-42e4-8fd5-a80e25049199 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:02:00.664059 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-fd6dfe68-ddb2-42e4-8fd5-a80e25049199 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011111 Jan 31 17:02:00.664635 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 33/67] 10.222.0.91 () {60 vars in 1285 bytes} [Mon Jan 31 17:02:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:02:00.675238 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:02:00.683303 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] 10.222.0.91 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011468 Jan 31 17:02:00.683816 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 35/68] 10.222.0.91 () {60 vars in 1282 bytes} [Mon Jan 31 17:02:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:03:29.153004 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-de1689af-62ec-4b49-9363-d94ec3ad7ba6 tempest-verify_tempest_config-1136328121 tempest-verify_tempest_config-1136328121-project] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:03:29.154997 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-de1689af-62ec-4b49-9363-d94ec3ad7ba6 tempest-verify_tempest_config-1136328121 tempest-verify_tempest_config-1136328121-project] 10.222.0.91 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103171 Jan 31 17:03:29.155563 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 34/69] 10.222.0.91 () {58 vars in 1133 bytes} [Mon Jan 31 17:03:29 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:05:07.360492 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:07.361687 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jan 31 17:05:07.362055 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 36/70] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:05:07.635934 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-b2b490e6-1bd7-459f-aafe-6b420f4957cd admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:07.637172 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:05:07.637172 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: warnings.warn(msg) Jan 31 17:05:07.638694 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-b2b490e6-1bd7-459f-aafe-6b420f4957cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:07.639135 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-b2b490e6-1bd7-459f-aafe-6b420f4957cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:07.639921 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-b2b490e6-1bd7-459f-aafe-6b420f4957cd admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:07.640370 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-b2b490e6-1bd7-459f-aafe-6b420f4957cd admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:07.675764 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-b2b490e6-1bd7-459f-aafe-6b420f4957cd admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160900 Jan 31 17:05:07.676351 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 35/71] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Jan 31 17:05:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:05:08.971478 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:08.972757 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Jan 31 17:05:08.973149 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 37/72] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:05:09.169045 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-0b2e6596-8d0c-4cc6-8a8b-0b1bf0faf6ba admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:09.169846 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:05:09.169846 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: warnings.warn(msg) Jan 31 17:05:09.171402 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-0b2e6596-8d0c-4cc6-8a8b-0b1bf0faf6ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:09.171851 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-0b2e6596-8d0c-4cc6-8a8b-0b1bf0faf6ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:09.172726 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-0b2e6596-8d0c-4cc6-8a8b-0b1bf0faf6ba admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:09.173243 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-0b2e6596-8d0c-4cc6-8a8b-0b1bf0faf6ba admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:09.193148 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-0b2e6596-8d0c-4cc6-8a8b-0b1bf0faf6ba admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079401 Jan 31 17:05:09.193640 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 36/73] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Jan 31 17:05:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:05:20.939661 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:20.940733 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jan 31 17:05:20.941129 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 38/74] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:05:21.137633 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-f3faf1fb-ee0f-4ffe-ba44-67f55ea8a00f admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:21.138795 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:05:21.138795 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: warnings.warn(msg) Jan 31 17:05:21.140382 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-f3faf1fb-ee0f-4ffe-ba44-67f55ea8a00f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:21.140849 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-f3faf1fb-ee0f-4ffe-ba44-67f55ea8a00f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:21.141641 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-f3faf1fb-ee0f-4ffe-ba44-67f55ea8a00f admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:21.142076 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-f3faf1fb-ee0f-4ffe-ba44-67f55ea8a00f admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:21.166346 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-f3faf1fb-ee0f-4ffe-ba44-67f55ea8a00f admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079998 Jan 31 17:05:21.167091 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 37/75] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Jan 31 17:05:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:05:22.557134 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: DEBUG nova.api.openstack.wsgi [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] Calling method '>' {{(pid=102017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:22.558204 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: INFO nova.api.openstack.requestlog [None req-ec96e37c-ae40-4dd1-9f6a-d45b6b93b338 admin admin] 10.222.0.91 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jan 31 17:05:22.558602 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: [pid: 102017|app: 0|req: 39/76] 10.222.0.91 () {56 vars in 1074 bytes} [Mon Jan 31 17:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:05:22.754245 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG nova.api.openstack.wsgi [None req-eac7997e-1d62-4378-8616-89e989d3b1a9 admin admin] Calling method '>' {{(pid=102018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:05:22.755710 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:05:22.755710 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: warnings.warn(msg) Jan 31 17:05:22.757385 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-eac7997e-1d62-4378-8616-89e989d3b1a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:22.757829 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-eac7997e-1d62-4378-8616-89e989d3b1a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:22.758656 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-eac7997e-1d62-4378-8616-89e989d3b1a9 admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:05:22.759137 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: DEBUG oslo_concurrency.lockutils [None req-eac7997e-1d62-4378-8616-89e989d3b1a9 admin admin] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:05:22.780046 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: INFO nova.api.openstack.requestlog [None req-eac7997e-1d62-4378-8616-89e989d3b1a9 admin admin] 10.222.0.91 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077847 Jan 31 17:05:22.780618 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: [pid: 102018|app: 0|req: 38/77] 10.222.0.91 () {60 vars in 1193 bytes} [Mon Jan 31 17:05:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:06:24.026561 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: Mon Jan 31 17:06:24 2022 - graceful shutdown triggered... Jan 31 17:06:24.027103 dv-cinder-815660-5-iscsi devstack@n-api.service[102017]: Gracefully killing worker 1 (pid: 102017)... Jan 31 17:06:24.026693 dv-cinder-815660-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 31 17:06:24.028018 dv-cinder-815660-5-iscsi devstack@n-api.service[102018]: Gracefully killing worker 2 (pid: 102018)... Jan 31 17:06:25.027280 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: worker 1 buried after 1 seconds Jan 31 17:06:25.027819 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: worker 2 buried after 1 seconds Jan 31 17:06:25.027819 dv-cinder-815660-5-iscsi devstack@n-api.service[102016]: goodbye to uWSGI. Jan 31 17:06:25.028864 dv-cinder-815660-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 31 17:06:25.029429 dv-cinder-815660-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 31 17:06:25.032454 dv-cinder-815660-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 31 17:06:25.041793 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 31 17:06:25 2022] *** Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: nodename: dv-cinder-815660-5-iscsi Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: machine: x86_64 Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: clock source: unix Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: pcre jit disabled Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: detected number of CPU cores: 4 Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: current working directory: / Jan 31 17:06:25.043792 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: detected binary path: /usr/bin/uwsgi-core Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: your processes number limit is 47680 Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: your memory page size is 4096 bytes Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: detected max file descriptor number: 2048 Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: lock engine: pthread robust mutexes Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: thunder lock: enabled Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 31 17:06:25.044573 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 31 17:06:25.091393 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: Python main interpreter initialized at 0x563a5e7c29c0 Jan 31 17:06:25.091393 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: python threads support enabled Jan 31 17:06:25.091393 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: your server socket listen backlog is limited to 100 connections Jan 31 17:06:25.091393 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: your mercy for graceful operations on workers is 90 seconds Jan 31 17:06:25.091847 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: mapped 403077 bytes (393 KB) for 2 cores Jan 31 17:06:25.091847 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: *** Operational MODE: preforking *** Jan 31 17:06:25.092163 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: *** uWSGI is running in multiple interpreter mode *** Jan 31 17:06:25.092163 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: spawned uWSGI master process (pid: 116463) Jan 31 17:06:25.092383 dv-cinder-815660-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 31 17:06:25.093300 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: spawned uWSGI worker 1 (pid: 116482, cores: 1) Jan 31 17:06:25.093300 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: spawned uWSGI worker 2 (pid: 116483, cores: 1) Jan 31 17:06:25.100312 dv-cinder-815660-5-iscsi devstack@n-api.service[116463]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 31 17:06:27.069355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 17:06:27.069355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: from cryptography.utils import int_from_bytes Jan 31 17:06:27.070071 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 17:06:27.070071 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: from cryptography.utils import int_from_bytes Jan 31 17:06:27.087716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 17:06:27.087716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: from cryptography.utils import int_from_bytes Jan 31 17:06:27.088316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 31 17:06:27.088316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: from cryptography.utils import int_from_bytes Jan 31 17:06:29.505297 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 17:06:29.505955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 17:06:29.506176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 17:06:29.506444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 17:06:29.506708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 17:06:29.507107 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.507442 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.507776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.508122 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.508473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.508794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.509143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.509473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.509810 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.510083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.510422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.510760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-5-iscsi {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.511104 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.511221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 31 17:06:29.511593 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.511709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 31 17:06:29.511807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.511978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 31 17:06:29.512084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.512370 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 31 17:06:29.512501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.512631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 31 17:06:29.512718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.513029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.513132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.513348 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.513543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.513682 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.514670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.514860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.514954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.515080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.515769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.515865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.515865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516800 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.516967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.517139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815660-5-iscsi {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.517248 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.517464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.517572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.517782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.517887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.518103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.518193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-5-iscsi {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.518430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.518526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.518745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.518845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.519076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.519172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.519392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.519549 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.519880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.519994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.520228 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.520325 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.520739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.520860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.520971 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521055 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521680 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521900 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.521990 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.522227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.522324 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.522543 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.522637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.522862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.522970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.523183 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.523287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.523502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.523601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815660-5-iscsi {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.523831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.523930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.524177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.524289 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.524496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.524586 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.524758 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.524953 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.525078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.525277 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.525412 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.525604 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.525743 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.525934 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.526074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.526279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.526369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.526584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.526678 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.526913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.527062 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.527246 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.527566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.527886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.527981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.528226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.528389 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.528548 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.528638 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.528869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.528958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.529187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.529287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.529504 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.529593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.529822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.529910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.530151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.530240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.530467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.530555 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.530778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.530926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.531105 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.531415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.531512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.531754 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.531851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532255 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532374 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.532947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.533102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.533282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.533435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.533603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.533761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.533926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.534098 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.534247 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.534433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.534570 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.534756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.534892 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.535074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.535213 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.535394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.535535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.535727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.535855 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.536073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.536282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.536416 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.536596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.536735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.536933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.537034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.537256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.537384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.537588 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.537719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.537918 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.538034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.91 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.538249 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.91 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.538365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.538566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.538692 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.538878 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539001 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539196 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539319 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.539955 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.540175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.540294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.540498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.540626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.540815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.540929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.541131 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.541254 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.542416 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.542610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.542708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.542850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.542939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543030 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543030 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543228 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543573 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543914 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.543996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.544139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545416 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545567 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.545924 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546102 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546445 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546788 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.546916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.547071 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.547250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.547394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.547566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.547704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.547888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.548037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.548242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.548386 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.548566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.548706 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.548887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549019 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549666 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.549956 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.550160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.550278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.550475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.550612 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.550790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.550932 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.551101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.551249 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.551430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.551576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.551782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.551924 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.552080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.552208 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.552420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.552542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.552739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.552856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.553068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.553161 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.553419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.553512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.553763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.553905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.554124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.554222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.554438 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.554534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.554757 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.554846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.555076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.555178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.555392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.555492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.555706 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.555795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.556021 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.556190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.556378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.556508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.556707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.556842 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.557033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.557133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.557354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.557487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.557674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.557772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.557992 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.558094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.558322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 31 17:06:29.558446 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.558649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.558746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.558974 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.559071 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.559307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.559397 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.559630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.559727 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.559960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.560058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.560323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.560423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.560652 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.560739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.560972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.561074 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.561295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.561392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.561633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.561730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.562509 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.562628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.562845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.562937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.563171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.563260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.563506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.563610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.563832 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.563926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.564180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.564274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.564515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.564611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.564843 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.564932 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.565170 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.565260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.565508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.565615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.565822 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.565911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.566148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.566235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.566479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.566576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.566795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.566885 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.567112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.567203 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.567430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.567528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.567752 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.567852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.568069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.568253 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.568424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.568522 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.568763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.568862 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.569081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.569184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.569404 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.569492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.569729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.569825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.570049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.570145 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.570371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.570461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.570692 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.570781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.571010 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.571107 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.571334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.571475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.571667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.571756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572006 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572161 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572781 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.572970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.573087 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.573286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.573412 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.573630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.573760 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.573920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.574046 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.574246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.574361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.574568 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.574681 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.574891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575199 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575521 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575843 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.575959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.576204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.576327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.576508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.576644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.576833 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.576949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.577151 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.577268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.577490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.578280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.578429 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.578541 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.578732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.578857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.579052 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.579184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.579390 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.579520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.579733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.579874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.580018 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.580135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.580369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.580459 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.580692 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.580788 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581013 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581830 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.581982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.582085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.582298 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.582432 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.582630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.582730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.582951 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.583041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.583266 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.583356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.583582 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.583689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.583911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584061 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584404 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584583 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584745 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.584997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.585224 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.585373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.585550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.585779 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.585881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.585972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.586167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.586265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.586486 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.586588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.586805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.586902 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.587122 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.587211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.587439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.587551 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.587778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.587887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.588096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.588322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.588427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.588520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.588738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.588880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.589058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.589150 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.589472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.589566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.589907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590681 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590833 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.590974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.591102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.591284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.591449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.591645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.591791 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.591938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.592078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.592372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.592523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.592700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.592842 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.593022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.593247 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.593452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.593943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594110 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594199 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594759 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.594995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.595125 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.595307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.595568 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.595729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.595950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.596089 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.596285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.596460 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.596606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.596918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.597060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.597258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.597388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.597602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.597779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.597990 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.598369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.598623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.598623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.598820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.598930 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.599180 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.599308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.599477 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.599826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.600141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.600256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.600370 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.600615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.600705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.600777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.601078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.601321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.601495 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.601659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.601761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.601982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.602188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.602305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.602602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.602917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.603036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.603249 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.603413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.603572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.603886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.604043 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.604303 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.604544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.604752 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.604871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.605160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.605259 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.605489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.605601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.605809 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.605963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.606125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.606441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.606540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.606756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.606888 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.607111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.607454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.607592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.607986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.608128 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.608217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.608357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.608467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.608686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.609399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.609775 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.609930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.610153 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.610283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.610424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.610584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.610772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.610993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.611132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.611363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.611453 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.611685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.611776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.612008 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.612160 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.612365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.612494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.612713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.612807 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613646 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.613971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.614058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.614287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.614384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.614604 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.614695 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.614922 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.615022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.615245 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.615535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.615664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.615890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.616250 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.616585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.616735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.616886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.617042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.617204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.617376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.617519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.617658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.617845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618239 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.618979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.619127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.619386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.619723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.620040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.620384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.620551 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.620690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.620861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.621010 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.621212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.621351 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.621564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.621694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.621903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622320 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622567 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622883 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.622974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.623199 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.623290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.623525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.623626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.623846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.623936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.625740 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.625897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.625980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626281 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626281 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626498 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.626808 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627011 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627128 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627338 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.627998 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.628138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.628778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.628894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.629142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.629258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.629470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.629575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.629815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.629909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.630171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.630334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.630502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.630611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.630848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.630950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.631189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.631283 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.631517 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.631610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.631839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.631932 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.632180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.632275 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.632500 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.632600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.632820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.632914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.633142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.633235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.633456 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.633596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.633770 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.633904 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.634092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.634221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.634431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.634556 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.634820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.635070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.635204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.635405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.635539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.635729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.635951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.636092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.636248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.636418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.636558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.636745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.636877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.637062 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.637200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.637385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.637516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.637706 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.637838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638021 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.638989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.639107 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.639315 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.639434 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.639639 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.639787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.639956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.640158 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.640438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.640602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.640765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.640912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.641083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.641225 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.641457 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.641602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.641772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.641905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.642033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.642172 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.642353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.642499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.642676 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.642811 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643473 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643655 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.643975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.644125 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.644316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.644458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.644634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.644775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.644947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.645078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.645264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.645395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.645577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.645717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.645889 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.646027 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.646203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.646344 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.646516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.646725 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.646867 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647123 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647578 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.647889 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.648072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.648236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.648406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.648525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.649408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.649547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.649669 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.649788 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.649909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650500 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650611 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.650946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651066 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.651937 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.652574 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.652738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.652884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.653971 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654110 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654247 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654375 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.654905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.655872 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.656000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660526 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660670 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.660969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661192 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661489 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.661941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662009 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662154 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662404 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662694 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.662934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.663012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.663090 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.663160 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.663253 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.663894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.663985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664057 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664311 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664676 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.664969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.665051 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.665127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.665196 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.665264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.665571 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.665851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666639 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.666948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.667095 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.667244 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.667403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.667552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.667707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.667856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.668050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.668252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.668394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.668552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.668701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.668850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669008 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669617 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.669915 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670063 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670063 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670611 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.670902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.671181 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.671848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.672056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.672737 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.672894 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673343 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673625 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.673930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674505 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674807 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.674954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675817 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.675964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.676133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.676296 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.676451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.676592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.676739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.676886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.677920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678209 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678350 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678635 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678775 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.678915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679211 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679824 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.679981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.680163 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.680321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.680487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.680642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.680800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.680942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.681110 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.681259 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.681433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.681625 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.681787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.681937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.682086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.682259 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.682501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.682981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.683145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.683295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.683446 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.683598 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.683748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.683909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684057 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684398 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684547 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684841 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.684987 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685134 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685562 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685853 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.685853 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.686117 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.686268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.686409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.686557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.686698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.686845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.687553 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.687782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.688019 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.688383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.688546 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.688690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.688832 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689354 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.689935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.690082 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.690231 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.690380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.690532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.690738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.690887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.691904 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.692051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.692228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.692380 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.692541 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.692687 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.693166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.693316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.693465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.693615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.693765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.693914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694057 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694205 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694638 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694789 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.694930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.695933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.696081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.696264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.696427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.696699 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.696854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.697008 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.697166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.697324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.697988 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.698150 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.698292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.698433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.698588 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.698737 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.698879 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699476 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699757 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.699897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700407 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700549 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.700837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.701127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.701277 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.701418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.701559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.701698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.701845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.702002 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.702143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.702282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.702282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.703441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.703698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.703958 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.704137 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.704287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.704428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.704569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.704708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.704860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705587 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.705896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706309 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706607 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706607 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.706964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707848 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.707989 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.708174 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.708174 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.708467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.708703 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.708851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.708991 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.709144 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.709144 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.709416 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.709578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.709720 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.709720 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710359 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710500 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710638 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.710935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711075 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711214 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.711953 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712710 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.712999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.713145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.713392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.713644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.713919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.714069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.714069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.714404 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.714570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.714713 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.714852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.715020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.715208 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.715393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.715393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.715734 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.715878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.716029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.716205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.716364 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.716515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.716664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.716822 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717333 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717481 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717633 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.717934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.718075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719215 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719840 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.719995 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.720218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.720368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.720521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.720521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.720805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.720959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.721175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.721175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.721447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.721587 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.721740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.721881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722176 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722176 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722624 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.722905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.723053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.723206 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.723380 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.723623 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.723878 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.724140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.724303 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.724466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.724624 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.724774 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.724923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.725949 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.726102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.726253 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.726421 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.726572 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.726713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.726713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727237 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.727999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.728178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.728339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.728498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.728647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.728802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.728964 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.729113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.729267 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.729414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.729568 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.729717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.729883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730031 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730482 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.730946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.731102 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.731261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.731409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.731570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.731733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.731882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.732029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.732233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.732414 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.732564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.732564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.732854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.733001 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.733148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.733302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.733467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.733641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.733928 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.734766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.735021 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.735265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.735542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.735800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.736054 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.736331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.736581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.736851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.737183 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.737571 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.737838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.738092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.738352 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.738541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.738703 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.738866 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739015 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739015 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739620 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739768 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.739768 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.740048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.740236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.740401 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.740564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.740733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.740881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741028 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741176 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741488 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.741936 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.742098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.742247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.742394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.742588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.742751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.742899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.743059 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.743214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.743362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.743508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.743655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.743801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.745180 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.745350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.745512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.745661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.745816 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.745984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.746209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.746360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.746509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.746665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.746826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.746986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.747196 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.747359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.747528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.747749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.747902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.748076 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.748265 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.748415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.748564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.748719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.748876 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.749032 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.749189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.749337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.749484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.749706 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.749956 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.750200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.750200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.750609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.750767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.750918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.751968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.752186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.752355 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.752503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.752650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.752799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.752959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.753108 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.753264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.753413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.753824 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.754073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.754323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.754478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.754478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.754787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.754949 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.755125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.755493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.755642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.755795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.755945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.756116 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.756289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.756440 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.756586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.756752 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.756985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.757150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.757299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.757446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.757600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.757772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758001 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758617 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.758919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.759093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.759241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.759395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.759551 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.759697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.759858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.760014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.760242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.760396 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.760551 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.760706 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.760867 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761330 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761789 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.761936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.762082 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.762235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.762383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.762540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.762697 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.762852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763018 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763673 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763829 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.763984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.764175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.764345 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.764584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.764739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.764886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.765851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.766194 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.766465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.766656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.766807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.766955 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.767102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.767102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.767396 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.767560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.767709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.767865 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.768178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.768338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.768501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.768656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.768814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.768963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.769118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.769118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.769406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.769563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.769719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.769866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770191 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770348 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770497 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770800 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.770954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.771110 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.771266 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.771422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.771578 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.771726 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.771872 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772039 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772228 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772681 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.772996 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116483) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.774856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.776217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.777171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.777171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.777171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.777599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.777778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.778105 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.778428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.778747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 31 17:06:29.779003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 31 17:06:29.792473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:29.802674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_db.sqlalchemy.engines [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:29.859954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.context [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd739326-28c2-4c93-a99b-2c85f99964f9(cell1) {{(pid=116483) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 17:06:29.864334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:06:29.865939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:06:29.866766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:06:29.868369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.context [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bd739326-28c2-4c93-a99b-2c85f99964f9(cell1) {{(pid=116482) load_cells /opt/stack/nova/nova/context.py:464}} Jan 31 17:06:29.868744 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:06:29.872185 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:06:29.873667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:06:29.874696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:06:29.878974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:06:29.880452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:29.882880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:29.888359 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_db.sqlalchemy.engines [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:29.889579 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_db.sqlalchemy.engines [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:30.044867 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_db.sqlalchemy.engines [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116483) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:30.049513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_db.sqlalchemy.engines [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 31 17:06:30.371605 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: WARNING keystonemiddleware.auth_token [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 17:06:30.376717 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: WARNING keystonemiddleware.auth_token [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 17:06:30.379455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: WARNING keystonemiddleware.auth_token [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 17:06:30.383666 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: WARNING keystonemiddleware.auth_token [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 17:06:30.728807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: WARNING keystonemiddleware.auth_token [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 17:06:30.734867 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: WARNING keystonemiddleware.auth_token [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 31 17:06:30.735285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: WARNING keystonemiddleware.auth_token [None req-4a8429b2-261b-4165-9b4f-1995db4f99f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 17:06:30.740116 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a5e7c29c0 pid: 116483 (default app) Jan 31 17:06:30.740274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: WARNING keystonemiddleware.auth_token [None req-78bcf485-207c-4138-ab20-8e6f742e9634 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 31 17:06:30.745786 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563a5e7c29c0 pid: 116482 (default app) Jan 31 17:07:06.297986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4fe57145-fe8a-497c-b1a7-9685efb85113 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Action: 'create', calling method: .version_select at 0x7fdce46c2ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-349974925", "metadata": {"Type": "work"}}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:06.300613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4fe57145-fe8a-497c-b1a7-9685efb85113 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:06.301733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4fe57145-fe8a-497c-b1a7-9685efb85113 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.261157 Jan 31 17:07:06.302852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 1/1] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Jan 31 17:07:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1263 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:07:06.313577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e5444a04-bae8-4693-aa49-a4914b31f35b tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Action: 'create', calling method: .version_select at 0x7fdce45a9820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1970754342", "metadata": {"Type": "work"}}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:06.320215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e5444a04-bae8-4693-aa49-a4914b31f35b tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:06.321604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e5444a04-bae8-4693-aa49-a4914b31f35b tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013095 Jan 31 17:07:06.322912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 2/2] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Jan 31 17:07:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:07:06.332335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-18a7166d-e676-4d41-ada5-6417c50c8b10 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Action: 'create', calling method: .version_select at 0x7fdce46c2d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2094974396", "metadata": {"Type": "work"}}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:06.333836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-18a7166d-e676-4d41-ada5-6417c50c8b10 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:06.334853 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-18a7166d-e676-4d41-ada5-6417c50c8b10 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006147 Jan 31 17:07:06.335876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 3/3] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Jan 31 17:07:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:07:06.354147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fe95ca19-3a12-40ba-a516-165f78095dcd tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Calling method '.version_select at 0x7fdce4649790>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:06.443759 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e63f9542-7c8e-4368-806b-bfa8ff6681bb tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Action: 'create', calling method: .version_select at 0x7fdce46c4ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1760313555", "metadata": {"Type": "work"}}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:07.021361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-fe95ca19-3a12-40ba-a516-165f78095dcd tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] HTTP exception thrown: Volume tempest-invalid-962437663 could not be found. Jan 31 17:07:07.022236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fe95ca19-3a12-40ba-a516-165f78095dcd tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Returning 404 to user: Volume tempest-invalid-962437663 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:07.023257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fe95ca19-3a12-40ba-a516-165f78095dcd tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/tempest-invalid-962437663" status: 404 len: 98 microversion: 2.1 time: 0.681674 Jan 31 17:07:07.027844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 4/4] 10.222.0.91 () {58 vars in 1214 bytes} [Mon Jan 31 17:07:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-962437663 => generated 98 bytes in 684 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 31 17:07:07.033836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-aad5eb95-afbc-4632-b7f4-6b24f4b5227d tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004371 Jan 31 17:07:07.035254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 5/5] 10.222.0.91 () {58 vars in 1139 bytes} [Mon Jan 31 17:07:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 31 17:07:07.048664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-22ad528e-2866-4f73-bd1e-e3106a10a126 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006340 Jan 31 17:07:07.051303 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 6/6] 10.222.0.91 () {58 vars in 1136 bytes} [Mon Jan 31 17:07:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 31 17:07:07.066108 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52009982-d2c5-4e51-97bb-84a34efdaab3 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Calling method '.version_select at 0x7fdce451bdc0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:07.121081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-52009982-d2c5-4e51-97bb-84a34efdaab3 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] HTTP exception thrown: Volume 53202b38-e4e3-4895-a369-6cd3bdcea46f could not be found. Jan 31 17:07:07.121804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52009982-d2c5-4e51-97bb-84a34efdaab3 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Returning 404 to user: Volume 53202b38-e4e3-4895-a369-6cd3bdcea46f could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:07.122794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-52009982-d2c5-4e51-97bb-84a34efdaab3 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/53202b38-e4e3-4895-a369-6cd3bdcea46f" status: 404 len: 109 microversion: 2.1 time: 0.066375 Jan 31 17:07:07.128844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 7/7] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Jan 31 17:07:07 2022] DELETE /compute/v2.1/os-volumes/53202b38-e4e3-4895-a369-6cd3bdcea46f => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:07:07.134479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bc058b87-27fe-4d9c-9605-c97bac1cb0e0 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Calling method '.version_select at 0x7fdce451ba60>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:07.181402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-bc058b87-27fe-4d9c-9605-c97bac1cb0e0 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] HTTP exception thrown: Volume 2e4a8085-877c-4e2d-a052-1fd4e6c72868 could not be found. Jan 31 17:07:07.182317 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bc058b87-27fe-4d9c-9605-c97bac1cb0e0 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] Returning 404 to user: Volume 2e4a8085-877c-4e2d-a052-1fd4e6c72868 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:07.183536 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bc058b87-27fe-4d9c-9605-c97bac1cb0e0 tempest-VolumesNegativeTest-574779545 tempest-VolumesNegativeTest-574779545-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/2e4a8085-877c-4e2d-a052-1fd4e6c72868" status: 404 len: 109 microversion: 2.1 time: 0.053259 Jan 31 17:07:07.185185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 8/8] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:07:07 2022] GET /compute/v2.1/os-volumes/2e4a8085-877c-4e2d-a052-1fd4e6c72868 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:07:07.841790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-253554366", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "16fc1cee-4030-4155-ac8c-c75537e343ae"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:08.318201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] validate_networks() for [('16fc1cee-4030-4155-ac8c-c75537e343ae', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:07:08.489676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e63f9542-7c8e-4368-806b-bfa8ff6681bb tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.004153 Jan 31 17:07:08.490738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 1/9] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Jan 31 17:07:05 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 31 17:07:08.619710 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-955137929", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "2b21c351-651c-4c3d-beee-1eb28627b536"}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:08.916194 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] validate_networks() for [('2b21c351-651c-4c3d-beee-1eb28627b536', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:07:10.203758 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:07:10.204350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:07:10.204739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:07:10.205188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:07:10.205607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:07:10.228313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:10.234938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:10.236789 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:10.237415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:10.302657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:10.321072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for user d7d72db9dcc44391af4b1703b0e4377a and project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:10.354941 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:07:10.364816 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:07:10.542035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8ef7925f-65d2-4962-b34b-b782e0b9a44b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.898115 Jan 31 17:07:10.547733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 9/10] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:07:10.564679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-472705c0-9426-4b5f-bd66-13c2a25bd723 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Calling method '.version_select at 0x7fdce3c360d0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:10.749129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:07:10.749850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:07:10.750047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:07:10.751968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:07:10.752460 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:07:10.788623 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:10.791179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:10.797102 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:10.797709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:10.798544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-472705c0-9426-4b5f-bd66-13c2a25bd723 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222" status: 200 len: 354 microversion: 2.1 time: 0.249371 Jan 31 17:07:10.799243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 10/11] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:07:10 2022] GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 => generated 354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:10.806208 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d884b55c-96bb-4a43-9c31-79bdc39c5eba tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:10.807917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d884b55c-96bb-4a43-9c31-79bdc39c5eba tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:10.939753 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Getting quotas for project 161162568607465d96fc8b944c451508. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:10.958767 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Getting quotas for user cf9997283faf44fe814ad2dc5511ee48 and project 161162568607465d96fc8b944c451508. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:10.980972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:07:10.985200 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:07:11.104056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5303c766-2690-4319-9ad4-1bdf34853626 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611995 Jan 31 17:07:11.105897 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 2/12] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:07:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:07:11.121392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d3c0f152-010a-462a-8ae8-b3d59fe48717 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Calling method '.version_select at 0x7fdce3c26550>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:11.183507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d884b55c-96bb-4a43-9c31-79bdc39c5eba tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:11.217838 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d884b55c-96bb-4a43-9c31-79bdc39c5eba tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1217 microversion: 2.1 time: 0.416634 Jan 31 17:07:11.222279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 11/13] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:10 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1217 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:11.237162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-25159a2b-eef2-492f-8952-b0b82b98d074 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:11.239809 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-25159a2b-eef2-492f-8952-b0b82b98d074 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:11.302067 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d3c0f152-010a-462a-8ae8-b3d59fe48717 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222" status: 200 len: 354 microversion: 2.1 time: 0.194742 Jan 31 17:07:11.302891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 3/14] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:07:11 2022] GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 => generated 354 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:11.322378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c66d0352-3c4b-404d-9e9b-51e525726eab tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Calling method '.version_select at 0x7fdce3c3d160>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:11.414733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-25159a2b-eef2-492f-8952-b0b82b98d074 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:11.441451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-25159a2b-eef2-492f-8952-b0b82b98d074 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1214 microversion: 2.1 time: 0.216964 Jan 31 17:07:11.442738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 12/15] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:11 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:11.616370 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c66d0352-3c4b-404d-9e9b-51e525726eab tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222" status: 202 len: 0 microversion: 2.1 time: 0.299254 Jan 31 17:07:11.617010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 4/16] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Jan 31 17:07:11 2022] DELETE /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:07:11.628021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8d4b4462-1a31-4ecf-a712-2b4a1c29beb3 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Calling method '.version_select at 0x7fdce33e5160>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:11.747186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8d4b4462-1a31-4ecf-a712-2b4a1c29beb3 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222" status: 200 len: 353 microversion: 2.1 time: 0.125925 Jan 31 17:07:11.749188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 13/17] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:07:11 2022] GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:12.242113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9b34eb62-529d-4911-a206-0c2b6f1ef663 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:12.242806 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9b34eb62-529d-4911-a206-0c2b6f1ef663 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:12.581725 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-905226304", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:12.683969 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] validate_networks() for [('3707ad66-1efd-423f-965f-9c101fe6803c', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:07:12.696265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9b34eb62-529d-4911-a206-0c2b6f1ef663 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:12.706253 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9b34eb62-529d-4911-a206-0c2b6f1ef663 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1217 microversion: 2.1 time: 0.467339 Jan 31 17:07:12.707981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 14/18] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:12 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1217 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:12.720557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:12.722298 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:12.735509 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:12.735977 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:12.736802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:12.737247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:13.207129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:13.283083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-37eee85c-f113-4530-b0de-f4be793d5240 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1218 microversion: 2.1 time: 0.573856 Jan 31 17:07:13.284396 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 15/19] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:12 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1218 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:13.297512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-40adbaa1-7f92-4ecd-8b78-6b6fec5c3792 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Calling method '.version_select at 0x7fdce336d430>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:13.356661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-40adbaa1-7f92-4ecd-8b78-6b6fec5c3792 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] HTTP exception thrown: Volume 34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 could not be found. Jan 31 17:07:13.357826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-40adbaa1-7f92-4ecd-8b78-6b6fec5c3792 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] Returning 404 to user: Volume 34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:07:13.359053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-40adbaa1-7f92-4ecd-8b78-6b6fec5c3792 tempest-VolumesGetTestJSON-878505192 tempest-VolumesGetTestJSON-878505192-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222" status: 404 len: 109 microversion: 2.1 time: 0.071001 Jan 31 17:07:13.360465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 16/20] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:07:13 2022] GET /compute/v2.1/os-volumes/34d9f8ae-3ae8-4de9-b6cd-8b809de7b222 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:07:13.726153 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:13.726767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:13.736891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:13.737746 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:13.739057 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:13.740862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:13.935509 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:13.949137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4aabe5e4-3a63-46ba-b3df-559a8dd30b16 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1269 microversion: 2.1 time: 0.225299 Jan 31 17:07:13.951995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 17/21] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:13 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1269 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:14.180552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:07:14.181048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:07:14.181444 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:07:14.184641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:07:14.188937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:07:14.215641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:14.220996 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:14.222469 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:14.226968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:14.275806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Getting quotas for project df34a02610e4463d9412c1f6b414a895. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:14.295772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Getting quotas for user 3c8dddb4201c494daba6b323eb5980ea and project df34a02610e4463d9412c1f6b414a895. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:14.302777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:14.304244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:14.313682 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:14.314997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:14.316188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:14.317310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:14.325155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:07:14.334319 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:07:14.452808 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-aae8bd03-a741-4de8-aa22-2238dfac3f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.535186 Jan 31 17:07:14.454152 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 5/22] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:07:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:07:14.463728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-169d477e-06aa-4085-acf8-93fec8978ae2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:14.466154 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-169d477e-06aa-4085-acf8-93fec8978ae2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:14.563729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:14.578079 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e648eb10-4511-4820-8403-49ecd24affc2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1274 microversion: 2.1 time: 0.279380 Jan 31 17:07:14.590705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 18/23] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:14 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:14.614647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-169d477e-06aa-4085-acf8-93fec8978ae2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:14.641446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-169d477e-06aa-4085-acf8-93fec8978ae2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1221 microversion: 2.1 time: 0.181048 Jan 31 17:07:14.654490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 6/24] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:14 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:14.836247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1772176666", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:14.928911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] validate_networks() for [('3707ad66-1efd-423f-965f-9c101fe6803c', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:07:14.968370 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:14.969204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:14.980216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:14.984961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:14.985953 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:14.986513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:15.597252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:15.636979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f92dc8da-cb70-45c1-b7bb-9960f97670dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1275 microversion: 2.1 time: 0.673207 Jan 31 17:07:15.646367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 7/25] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:14 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1275 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:15.660859 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:15.666009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:15.699265 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:15.702861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:15.705651 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:15.708825 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:16.171836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:16.201849 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-89baf66c-9968-4c0e-ace4-35ab33295a3c tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1272 microversion: 2.1 time: 0.553915 Jan 31 17:07:16.212795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 8/26] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:15 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1272 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:16.659159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:16.659939 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:16.674389 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:16.674978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:16.675968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:16.676686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:16.737239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:07:16.738422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:07:16.739057 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:07:16.739626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:07:16.740214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:07:16.760815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:16.763019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:16.768034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:16.770345 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:16.863812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Getting quotas for project df34a02610e4463d9412c1f6b414a895. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:16.883368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Getting quotas for user 3c8dddb4201c494daba6b323eb5980ea and project df34a02610e4463d9412c1f6b414a895. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:16.936299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:07:16.957115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:07:17.090240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:17.113719 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4ba75961-8fd2-45c9-9918-d052f21fcb2b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1275 microversion: 2.1 time: 0.458576 Jan 31 17:07:17.118094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 9/27] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:16 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1275 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:17.169040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bed0d503-b901-47a4-9268-9a5a497f00af tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.335291 Jan 31 17:07:17.177732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 19/28] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:07:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:07:17.183453 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a18513d8-e11c-4af3-9f6a-88b63cebbd2d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:17.184895 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a18513d8-e11c-4af3-9f6a-88b63cebbd2d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:17.231955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:17.233321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:17.259953 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:17.260461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:17.261311 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:17.261768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:17.631687 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a18513d8-e11c-4af3-9f6a-88b63cebbd2d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:17.665392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a18513d8-e11c-4af3-9f6a-88b63cebbd2d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1222 microversion: 2.1 time: 0.485939 Jan 31 17:07:17.670448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 10/29] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:17 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1222 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:17.681492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:17.690331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-62207971-93e7-467c-9ee2-4896ab8371a8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1272 microversion: 2.1 time: 0.462466 Jan 31 17:07:17.690926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 20/30] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:17 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1272 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:18.133671 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:18.134528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:18.160008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:18.164501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:18.168026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:18.171123 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:18.693019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:18.695190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:18.706053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:18.706871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:18.707903 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:18.708616 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:19.542456 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:19.545188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:19.558167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5c29c708-38a8-4873-af34-525cf598a87e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1218 microversion: 2.1 time: 0.874968 Jan 31 17:07:19.559347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9d7d0b52-92a5-4d15-be04-84813a784a2c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1275 microversion: 2.1 time: 1.429352 Jan 31 17:07:19.561108 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 11/31] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:18 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1275 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:19.573009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:19.573983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:19.576070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 21/32] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:18 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1218 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:19.587304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:19.591446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:19.593318 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:19.594002 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:20.584023 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:20.586565 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:20.611210 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:20.613807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:20.614653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:20.617609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:22.248077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:22.259820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-256af2b9-ee25-4b18-bbba-f5e82bf7dab3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 2.697273 Jan 31 17:07:22.260727 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 12/33] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:19 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 2699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:22.276531 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:22.277361 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:22.293163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:22.293622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:22.295596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:22.296857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:23.055522 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:23.085195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cfb8c352-73e4-450e-a2d8-dc6257fda1de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1218 microversion: 2.1 time: 0.816148 Jan 31 17:07:23.086885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:23.095785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 13/34] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:22 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1218 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:23.106537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-28a7ad07-b85b-46fc-8b3f-258fbfb7b452 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 2.528062 Jan 31 17:07:23.119651 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 22/35] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:20 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:23.277886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:23.279979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:23.297575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:23.298986 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:23.302482 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:23.318506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:24.104006 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:24.104996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:24.122158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:24.123256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:24.126714 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:24.127206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:24.903266 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:24.923175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d0aed28b-9ad1-4f6e-a3e3-873c8833513f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1280 microversion: 2.1 time: 0.820777 Jan 31 17:07:24.928844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 23/36] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:24 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1280 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:24.940888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:24.946657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:24.969746 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:24.971463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:24.973440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:24.975499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:25.380151 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:25.392143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-01f74690-f630-4a76-91a7-479bc2e3d82a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 2.118606 Jan 31 17:07:25.393925 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 14/37] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:23 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:25.635073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:25.645829 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7da10909-973d-4a44-83d2-a4beb4b63919 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.715370 Jan 31 17:07:25.648403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 24/38] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:24 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:25.946301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:25.947308 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:25.963622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:25.964084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:25.969761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:25.971290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:26.413482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:26.414336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:26.427647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:26.438105 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-25f7c606-63a1-49cb-800a-86c1350d73f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1280 microversion: 2.1 time: 0.496358 Jan 31 17:07:26.440675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:26.441206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:26.443124 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 15/39] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:25 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1280 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:26.449138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:26.450120 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:26.665835 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:26.666737 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:26.682899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:26.683938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:26.685006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:26.688541 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:27.305797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:27.319225 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-326f5014-11f1-4a4c-89a6-e670de9a5c4e tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.909293 Jan 31 17:07:27.322083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 25/40] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:26 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:27.418154 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:27.428965 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f3264aa2-b925-45d0-bcbb-0313d923f5fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.767219 Jan 31 17:07:27.429627 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 16/41] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:26 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:27.470080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:27.470795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:27.483207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:27.484954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:27.485827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:27.486329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:27.694959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:27.713219 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-da9d0437-b2b9-4ad0-8a3c-5437155bd774 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1280 microversion: 2.1 time: 0.256366 Jan 31 17:07:27.727426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 26/42] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:27 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:28.208378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-754f4528-c8dd-454e-a8b1-1f02092840e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: .version_select at 0x7fdce4eae550>, body: {"keypair": {"name": "tempest-keypair-1115834682"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:28.291438 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-754f4528-c8dd-454e-a8b1-1f02092840e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:28.319868 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-754f4528-c8dd-454e-a8b1-1f02092840e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for user 0edd35fd91c045238a8e7a65bec256cd and project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:28.337471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:28.339006 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:28.353430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:28.354149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:28.356415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:28.359723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:29.027012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-754f4528-c8dd-454e-a8b1-1f02092840e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:29.039424 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-754f4528-c8dd-454e-a8b1-1f02092840e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for user 0edd35fd91c045238a8e7a65bec256cd and project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:29.093791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-754f4528-c8dd-454e-a8b1-1f02092840e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.538354 Jan 31 17:07:29.107904 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 17/43] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Jan 31 17:07:27 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:29.122089 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:29.125347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:29.157886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:29.160001 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:29.165961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:29.166645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:30.186660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:30.200442 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-da7d949c-53d2-4112-8003-1d0a0d20d292 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 1.867477 Jan 31 17:07:30.205404 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 27/44] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:28 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:30.398653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-96cef9e2-d918-4f36-a731-b1cf7f9862b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'create', calling method: .version_select at 0x7fdce33d1f70>, body: {"keypair": {"name": "tempest-keypair-592047010"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:30.443883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:30.452183 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2323112d-fa1d-445a-8f9a-1a5cd24dd7da tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 1.349948 Jan 31 17:07:30.457156 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 18/45] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:29 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:30.466741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-96cef9e2-d918-4f36-a731-b1cf7f9862b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:30.469558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:30.470484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:30.475157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-96cef9e2-d918-4f36-a731-b1cf7f9862b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for user 2cae436f97f74de1bebd6c763867bfa0 and project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:30.485216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:30.486826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:30.488651 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:30.492747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:30.905207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-96cef9e2-d918-4f36-a731-b1cf7f9862b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:30.917012 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-96cef9e2-d918-4f36-a731-b1cf7f9862b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for user 2cae436f97f74de1bebd6c763867bfa0 and project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:30.961331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-96cef9e2-d918-4f36-a731-b1cf7f9862b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.752528 Jan 31 17:07:30.962295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 28/46] 10.222.0.91 () {62 vars in 1198 bytes} [Mon Jan 31 17:07:30 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 755 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 31 17:07:31.122188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:31.131785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e9445ec2-2928-4db6-b8e9-df0a5e651e6c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.673235 Jan 31 17:07:31.137476 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 19/47] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:30 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:31.224905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:31.226685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:31.247769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.251009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.256776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.257250 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.332941 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-59630720-289b-4e4d-84dd-c1277a35dc67 req-7a5746bd-fe6c-469d-a1ff-6e882dac29c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd45ffd-1f91-4a04-9013-b2b497b37864", "tag": "74552b91-d3a1-48c0-b8b0-43fe372bf46f"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:31.335417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:31.335417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:07:31.363765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-59630720-289b-4e4d-84dd-c1277a35dc67 req-7a5746bd-fe6c-469d-a1ff-6e882dac29c5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.364426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-59630720-289b-4e4d-84dd-c1277a35dc67 req-7a5746bd-fe6c-469d-a1ff-6e882dac29c5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.417000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-59630720-289b-4e4d-84dd-c1277a35dc67 req-7a5746bd-fe6c-469d-a1ff-6e882dac29c5 service nova] Creating event network-changed:74552b91-d3a1-48c0-b8b0-43fe372bf46f for instance bcd45ffd-1f91-4a04-9013-b2b497b37864 on hv-cinder-81566 Jan 31 17:07:31.418714 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-59630720-289b-4e4d-84dd-c1277a35dc67 req-7a5746bd-fe6c-469d-a1ff-6e882dac29c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 31 17:07:31.421046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.425286 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.426530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.428365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.455033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.compute.rpcapi [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 31 17:07:31.457998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] Releasing lock "compute-rpcapi-router" {{(pid=116483) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 31 17:07:31.492931 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8e635b63-b526-4a7e-a175-8b8a82650a30 None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.528747 Jan 31 17:07:31.493972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 29/48] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:31.505742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:31.506808 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:31.528407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.529921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.532135 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:31.533866 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:31.858369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:31.868818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3f842dc5-ade5-456f-bf95-62b3608f324d tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.651579 Jan 31 17:07:31.869461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 20/49] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:31 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:32.043463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:32.051892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5a213616-858e-42b9-be9a-693481dd8fc1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.556497 Jan 31 17:07:32.063361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 30/50] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:31 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:32.132888 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-0706b479-6bbd-4fb4-b251-be29e686f892 req-c096ce54-8455-4992-8f4a-69123b4ecf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee59a59-7ed3-4b35-8a54-a257556f657c", "tag": "43e0b7d5-4414-4dd9-92d3-0c1b9fddd337"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:32.135360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:32.135360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:07:32.150212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:32.151083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:32.159472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-0706b479-6bbd-4fb4-b251-be29e686f892 req-c096ce54-8455-4992-8f4a-69123b4ecf8d service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.159619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.160367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-0706b479-6bbd-4fb4-b251-be29e686f892 req-c096ce54-8455-4992-8f4a-69123b4ecf8d service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:32.163198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:32.164517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.165658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:32.217449 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-0706b479-6bbd-4fb4-b251-be29e686f892 req-c096ce54-8455-4992-8f4a-69123b4ecf8d service nova] Creating event network-changed:43e0b7d5-4414-4dd9-92d3-0c1b9fddd337 for instance 1ee59a59-7ed3-4b35-8a54-a257556f657c on hv-cinder-81566 Jan 31 17:07:32.218160 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-0706b479-6bbd-4fb4-b251-be29e686f892 req-c096ce54-8455-4992-8f4a-69123b4ecf8d service nova] Acquired lock "compute-rpcapi-router" {{(pid=116482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 31 17:07:32.219545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.220133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:32.221054 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.221604 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:32.241663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.compute.rpcapi [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 31 17:07:32.243729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] Releasing lock "compute-rpcapi-router" {{(pid=116482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 31 17:07:32.275592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fe25bb8f-91a3-4d7b-87c9-3037dfbb148a None None] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401912 Jan 31 17:07:32.285377 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 21/51] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:32.539981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:32.564908 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4b631fab-171f-4ef4-b965-6af5f224c2cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.413643 Jan 31 17:07:32.565560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 31/52] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:32 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:32.896542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:32.898131 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:32.914958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.915425 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:32.916323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:32.916773 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:33.071248 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:33.072167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:33.079376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:33.080282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:33.082137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:33.082972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:33.637070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:33.645237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d2df5e43-8d05-4c87-8a47-2992f955a539 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.762515 Jan 31 17:07:33.645832 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 22/53] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:32 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:33.674362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-ecc1b30c-dbf8-47b3-8377-878a6778b27b req-a16e4e87-91a0-4154-8624-e011ba2dfb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b129cbbf-8ef7-494c-ac01-075b087f7cfc", "tag": "ac265cc5-fbf2-4309-8e14-2ed6a9b2682f"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:33.676578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:33.676578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:07:33.692656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ecc1b30c-dbf8-47b3-8377-878a6778b27b req-a16e4e87-91a0-4154-8624-e011ba2dfb33 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:33.693253 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ecc1b30c-dbf8-47b3-8377-878a6778b27b req-a16e4e87-91a0-4154-8624-e011ba2dfb33 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:33.712019 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-ecc1b30c-dbf8-47b3-8377-878a6778b27b req-a16e4e87-91a0-4154-8624-e011ba2dfb33 service nova] Creating event network-changed:ac265cc5-fbf2-4309-8e14-2ed6a9b2682f for instance b129cbbf-8ef7-494c-ac01-075b087f7cfc on hv-cinder-81566 Jan 31 17:07:33.725060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-ecc1b30c-dbf8-47b3-8377-878a6778b27b req-a16e4e87-91a0-4154-8624-e011ba2dfb33 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063598 Jan 31 17:07:33.726061 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 23/54] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:33.743917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:33.745857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:33.753079 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:33.753785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:33.755466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:33.756165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:33.981567 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:34.005050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cc2cb00f-235b-4b95-a623-9af258853c27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.933682 Jan 31 17:07:34.005738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 32/55] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:33 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:34.639799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:34.654044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5f8c87f3-312d-4894-8091-f0631f13ba26 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.926311 Jan 31 17:07:34.655167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 24/56] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:33 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:34.666071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:34.667085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:34.675727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:34.676595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:34.678486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:34.679212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:35.024714 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:35.025789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:35.029378 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:35.043300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f4ecf8f1-6ebf-43e7-8a78-40a0e57f4323 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.384342 Jan 31 17:07:35.047907 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 33/57] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:34 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:35.048810 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:35.049448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:35.052266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:35.053336 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:35.386618 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:35.400193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7f147158-0d66-4407-bce7-5a044760aac8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.381365 Jan 31 17:07:35.400800 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 25/58] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:35 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:35.423977 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-623581595", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cee72dd-bdc6-4eeb-b5e0-7fb5d5eec549"}], "security_groups": [{"name": "tempest-securitygroup--566861679"}], "key_name": "tempest-keypair-592047010", "user_data": "}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:35.543520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1683843175", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fce1dfc-5404-4796-a910-cdbbaddc1cc6"}], "security_groups": [{"name": "tempest-securitygroup--1722174218"}], "key_name": "tempest-keypair-1115834682", "user_data": "}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:35.728922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] validate_networks() for [('8cee72dd-bdc6-4eeb-b5e0-7fb5d5eec549', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:07:35.764390 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] validate_networks() for [('4fce1dfc-5404-4796-a910-cdbbaddc1cc6', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:07:36.641380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:07:36.642228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:07:36.643227 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:07:36.643909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:07:36.644365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:07:36.653490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.654622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.657561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:07:36.658123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:07:36.658837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:07:36.659264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:07:36.659930 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:07:36.663800 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.664503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.681480 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.681827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.683041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.683466 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.687942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:36.692038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for user 0edd35fd91c045238a8e7a65bec256cd and project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:36.701514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for project cef2ba1be78a47e4b1e70224544c7828. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:07:36.704544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:07:36.705448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for user 2cae436f97f74de1bebd6c763867bfa0 and project cef2ba1be78a47e4b1e70224544c7828. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:07:36.707172 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:07:36.717291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:07:36.719851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:07:36.754775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9a6cc171-efdf-41a8-8ae2-6c5b8987c001 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.215500 Jan 31 17:07:36.756193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 26/59] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:07:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:07:36.760771 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:36.761685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:36.770663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.771906 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.772931 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.773593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.782272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-426e6770-cecd-4eb0-b8da-e520102a526b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.364932 Jan 31 17:07:36.788868 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 34/60] 10.222.0.91 () {62 vars in 1187 bytes} [Mon Jan 31 17:07:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 31 17:07:36.793440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:36.811218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:36.822114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.824247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:36.825523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:36.826919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:37.103205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:37.114255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3358e686-2413-4c98-9d47-e62c8f3384e9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.356706 Jan 31 17:07:37.124958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 27/61] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:36 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:37.143683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-fa73d6a3-5e2e-48c2-8557-c2189c324914 req-b93adc36-e3f7-4d39-b9d4-ab623f827afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd43f047-fa56-444b-8a9b-7d654a7c2ffa", "tag": "8434aa23-793d-4765-94c2-651d579a7981"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:37.146804 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:37.146804 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:07:37.155959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:37.168328 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-fa73d6a3-5e2e-48c2-8557-c2189c324914 req-b93adc36-e3f7-4d39-b9d4-ab623f827afb service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:37.168654 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-fa73d6a3-5e2e-48c2-8557-c2189c324914 req-b93adc36-e3f7-4d39-b9d4-ab623f827afb service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:37.175276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9eec0a63-8329-4337-a8e9-deeee6a6400f tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.385280 Jan 31 17:07:37.178081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 35/62] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:36 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:37.189538 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:37.190750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:37.195099 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-fa73d6a3-5e2e-48c2-8557-c2189c324914 req-b93adc36-e3f7-4d39-b9d4-ab623f827afb service nova] Creating event network-changed:8434aa23-793d-4765-94c2-651d579a7981 for instance bd43f047-fa56-444b-8a9b-7d654a7c2ffa on hv-cinder-81566 Jan 31 17:07:37.200993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-fa73d6a3-5e2e-48c2-8557-c2189c324914 req-b93adc36-e3f7-4d39-b9d4-ab623f827afb service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064076 Jan 31 17:07:37.201968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 28/63] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:37.208868 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2e147015-ff4b-4b1b-b1fa-3df1b0c141a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:37.209812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2e147015-ff4b-4b1b-b1fa-3df1b0c141a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:37.215074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:37.215597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:37.217176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:37.217689 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:37.831621 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2e147015-ff4b-4b1b-b1fa-3df1b0c141a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:37.845640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2e147015-ff4b-4b1b-b1fa-3df1b0c141a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1238 microversion: 2.1 time: 0.642164 Jan 31 17:07:37.849381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 29/64] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:37 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1238 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:37.868719 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2eae1271-141a-4c71-8bc9-6afa292e6de7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:37.871584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2eae1271-141a-4c71-8bc9-6afa292e6de7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:37.987559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2eae1271-141a-4c71-8bc9-6afa292e6de7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:37.995713 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2eae1271-141a-4c71-8bc9-6afa292e6de7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:38.003129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2eae1271-141a-4c71-8bc9-6afa292e6de7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:38.007984 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2eae1271-141a-4c71-8bc9-6afa292e6de7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1280 microversion: 2.20 time: 0.157430 Jan 31 17:07:38.029232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 30/65] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:37 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:38.064683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:38.077177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0aa6dadd-2336-4a3a-8fd5-6ddf70dcd948 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.897580 Jan 31 17:07:38.084449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 36/66] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:37 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:38.147010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:38.147713 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:38.157103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:38.160856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:38.161910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:38.180723 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:38.194451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:38.195162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:38.203900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:38.220594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:38.221622 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:38.222088 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:38.765333 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:38.774537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:38.779038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-68e43e9f-1147-4fea-b14c-fc4f31daddbc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.637777 Jan 31 17:07:38.783561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-36a30334-afb7-4f37-ad58-1d4f08155a36 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.593340 Jan 31 17:07:38.784483 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 37/67] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:38 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:38.790777 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 31/68] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:38 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:38.865986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:38.866595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:38.876065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:38.876641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:38.877701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:38.878322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.009764 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:39.023486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-807322dc-852a-48a0-83f0-6518555aada5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1296 microversion: 2.1 time: 0.160979 Jan 31 17:07:39.025505 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 38/69] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:38 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:39.040665 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:39.041890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:39.053191 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.053975 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.055010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.055503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.095402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:39.096546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:39.109511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.110376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.111389 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.112057 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.171365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:39.180846 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:39.182792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:39.184056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f760a36e-73dc-4e65-924d-a3ec5269a68c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1332 microversion: 2.20 time: 0.152323 Jan 31 17:07:39.185383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 32/70] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:39 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1332 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:39.412317 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:39.420953 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7f305827-e24b-486d-b06d-ea6f2bb14d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.331380 Jan 31 17:07:39.421597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 39/71] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:39 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:39.798291 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:39.798837 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:39.801488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:39.802119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:39.812715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.813252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.814187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.814671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.816621 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.817416 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:39.818243 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:39.818687 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.145025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.171232 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ada53ce6-1aad-4c2f-b73e-fb09165478b5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.371699 Jan 31 17:07:40.188282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.192316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 40/72] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:39 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:40.203024 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:40.207278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-931af273-65f3-4094-ab0b-77d3b7a60aaa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.413996 Jan 31 17:07:40.208445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 33/73] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:39 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:40.213891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:40.217534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:40.221407 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:40.229186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:40.229654 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.230464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:40.230915 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.238369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:40.238893 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.239779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:40.241306 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.382873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.393101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.395056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.408295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d0b3323d-732c-4c8e-b3a3-ff7451cfbccc tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1338 microversion: 2.20 time: 0.186975 Jan 31 17:07:40.410887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 34/74] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:40 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1338 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:40.440807 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:40.442088 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:40.449199 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:40.450021 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.451134 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:40.451804 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:40.596329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.605291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6e311b93-1787-4407-ab46-47497630b074 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.407729 Jan 31 17:07:40.609594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 41/75] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:40 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:40.724504 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:40.745023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-323941c3-2a7f-495a-aeb2-3d21b52e1b02 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.310265 Jan 31 17:07:40.745794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 35/76] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:40 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:41.192062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:41.193309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:41.203388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.204131 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.205299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.206304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.226104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:41.226909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:41.238586 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.239109 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.239848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.240356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.653728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:41.664970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-52423e0d-a1d4-480f-8401-be521a2c9253 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.476249 Jan 31 17:07:41.667270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 42/77] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:41 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:41.674694 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:41.675331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:41.675935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:41.685912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.686518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.686886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-228cbd3f-199b-4c09-a4fb-c68240f61862 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.465558 Jan 31 17:07:41.687633 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.688514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.696967 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 36/78] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:41 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:41.706820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:41.707774 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:41.715103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.715925 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:41.717481 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:41.718336 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.090538 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:42.100599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:42.101182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3793dd8c-2478-4a14-b04f-4fff4108feb3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.402279 Jan 31 17:07:42.112389 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 37/79] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:41 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:42.115578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:42.116232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:42.123740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:42.125930 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:42.127660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9726ba86-1cd2-42c0-9d4b-4ab31e7b4d8d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.458879 Jan 31 17:07:42.128826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 43/80] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:41 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:42.134926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-c912094f-1a38-4092-b249-8b2c73057ef6 req-6f934d8c-f977-4315-8d28-d7bfbcc827e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578b3d82-02e9-4759-b0e3-ad4ff650a4c4", "tag": "e6a7874f-beac-4e94-88c7-ad9d8063cb4a"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:42.136825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:42.136825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:07:42.139749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.142483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.143557 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.144997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-c912094f-1a38-4092-b249-8b2c73057ef6 req-6f934d8c-f977-4315-8d28-d7bfbcc827e1 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.145554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-c912094f-1a38-4092-b249-8b2c73057ef6 req-6f934d8c-f977-4315-8d28-d7bfbcc827e1 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.145933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.160216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-c912094f-1a38-4092-b249-8b2c73057ef6 req-6f934d8c-f977-4315-8d28-d7bfbcc827e1 service nova] Creating event network-changed:e6a7874f-beac-4e94-88c7-ad9d8063cb4a for instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 on hv-cinder-81566 Jan 31 17:07:42.169073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-c912094f-1a38-4092-b249-8b2c73057ef6 req-6f934d8c-f977-4315-8d28-d7bfbcc827e1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037038 Jan 31 17:07:42.174836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 44/81] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:42.443802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:42.460010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4b2c3893-c112-4f74-ad69-6bcc7863798e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.347596 Jan 31 17:07:42.464299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 38/82] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:42 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:42.686264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:42.687359 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:42.698857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.699378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.703426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.703936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.820381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-779e164a-53e3-41e3-bbd2-22cf553d8370 req-d1c03f93-f93c-4755-9808-eda6062da9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd45ffd-1f91-4a04-9013-b2b497b37864", "name": "network-vif-plugged", "status": "completed", "tag": "74552b91-d3a1-48c0-b8b0-43fe372bf46f"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:42.822957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:42.822957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:07:42.847160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-779e164a-53e3-41e3-bbd2-22cf553d8370 req-d1c03f93-f93c-4755-9808-eda6062da9c0 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.847619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-779e164a-53e3-41e3-bbd2-22cf553d8370 req-d1c03f93-f93c-4755-9808-eda6062da9c0 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.878173 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-779e164a-53e3-41e3-bbd2-22cf553d8370 req-d1c03f93-f93c-4755-9808-eda6062da9c0 service nova] Creating event network-vif-plugged:74552b91-d3a1-48c0-b8b0-43fe372bf46f for instance bcd45ffd-1f91-4a04-9013-b2b497b37864 on hv-cinder-81566 Jan 31 17:07:42.884289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-779e164a-53e3-41e3-bbd2-22cf553d8370 req-d1c03f93-f93c-4755-9808-eda6062da9c0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370842 Jan 31 17:07:42.888541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 45/83] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:42.895465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:42.896211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:42.904518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.905214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.906185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:42.906642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:42.952719 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:42.970158 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d7806433-b1d6-4118-8bed-9eab5ffee0e7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.290763 Jan 31 17:07:42.971053 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 39/84] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:42 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:43.107593 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:43.121116 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:43.122117 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:43.132642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:43.133719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7ac4d80b-6660-422e-9e52-4a93d947ccb6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.242056 Jan 31 17:07:43.135615 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:43.138986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 46/85] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:42 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:43.139240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:43.139994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:43.145426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:43.150684 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:43.183086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:43.183554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:43.185062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:43.186403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:43.530601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:43.533915 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:43.539562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b92ed3c3-a4a8-4023-81df-aab5722b2241 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.422876 Jan 31 17:07:43.540378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 40/86] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:43 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:43.543161 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:43.544843 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:43.545981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-539f5398-a4a2-40ce-a9cc-c6ee2ec49216 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.404226 Jan 31 17:07:43.546537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 47/87] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:43 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:43.557317 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:43.557938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:43.565975 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:43.566508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:43.567393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:43.567866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:43.744865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:43.758636 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ce7ac9e5-f970-443d-af3d-61de64723b4b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.216680 Jan 31 17:07:43.759704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 41/88] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:43 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:43.993902 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:43.995545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:44.018061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.018924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.020891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.021550 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.154860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:44.155696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:44.165748 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.167093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.169520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.171392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.412803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.421742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b33d27e8-f844-4c01-95be-0e239d687a51 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.436907 Jan 31 17:07:44.422368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 48/89] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:43 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:44.442286 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-d7540c8a-6787-4586-acac-a7cafb80f5cf req-28d19887-c27a-4f57-9544-38290f8bbe1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:44.444161 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:44.444161 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:07:44.466743 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-d7540c8a-6787-4586-acac-a7cafb80f5cf req-28d19887-c27a-4f57-9544-38290f8bbe1e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.467638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-d7540c8a-6787-4586-acac-a7cafb80f5cf req-28d19887-c27a-4f57-9544-38290f8bbe1e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.489278 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-d7540c8a-6787-4586-acac-a7cafb80f5cf req-28d19887-c27a-4f57-9544-38290f8bbe1e service nova] Creating event network-changed:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:07:44.495480 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-d7540c8a-6787-4586-acac-a7cafb80f5cf req-28d19887-c27a-4f57-9544-38290f8bbe1e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056748 Jan 31 17:07:44.496674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 49/90] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:44.557848 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:44.558618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:44.567795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.568293 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.570316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.576142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.597319 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.608094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7ee2b7f9-9785-4362-8c4a-112b900b6280 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.457281 Jan 31 17:07:44.609520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 42/91] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:44 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:44.614035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:44.614642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:44.621470 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.622062 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.622925 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.623365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.814926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.818523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.822924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c6ee8adb-520b-4980-8e05-93ef0632bf0f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.269345 Jan 31 17:07:44.823655 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 50/92] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:44 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:44.828419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:44.829170 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:44.835407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.835871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.836653 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.836798 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.837111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.838153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.839263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ed2dbf62-4e7a-429d-bd96-09e741908440 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.228660 Jan 31 17:07:44.839819 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 43/93] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:44 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:44.901035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b129cbbf-8ef7-494c-ac01-075b087f7cfc", "name": "network-vif-plugged", "status": "completed", "tag": "ac265cc5-fbf2-4309-8e14-2ed6a9b2682f"}, {"server_uuid": "bd43f047-fa56-444b-8a9b-7d654a7c2ffa", "name": "network-vif-plugged", "status": "completed", "tag": "8434aa23-793d-4765-94c2-651d579a7981"}, {"server_uuid": "1ee59a59-7ed3-4b35-8a54-a257556f657c", "name": "network-vif-plugged", "status": "completed", "tag": "43e0b7d5-4414-4dd9-92d3-0c1b9fddd337"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:44.902865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:44.902865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:07:44.911184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:44.911640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:44.925676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] Creating event network-vif-plugged:ac265cc5-fbf2-4309-8e14-2ed6a9b2682f for instance b129cbbf-8ef7-494c-ac01-075b087f7cfc on hv-cinder-81566 Jan 31 17:07:44.926189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] Creating event network-vif-plugged:8434aa23-793d-4765-94c2-651d579a7981 for instance bd43f047-fa56-444b-8a9b-7d654a7c2ffa on hv-cinder-81566 Jan 31 17:07:44.926693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] Creating event network-vif-plugged:43e0b7d5-4414-4dd9-92d3-0c1b9fddd337 for instance 1ee59a59-7ed3-4b35-8a54-a257556f657c on hv-cinder-81566 Jan 31 17:07:44.935472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-4cdfff07-dbf0-42a6-a78d-5edb7aa34735 req-c860568c-4dac-4b49-b25f-849de3bced49 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037187 Jan 31 17:07:44.936080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 44/94] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:07:44.973448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:44.980658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-34876785-693f-4796-afd0-4c63562b28ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.155800 Jan 31 17:07:44.981236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 51/95] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:44 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:45.439906 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:45.440635 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:45.446711 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.447169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.447944 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.448419 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.583585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:45.591428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-35e9cea2-30c4-4da1-9e60-6a68797b00f0 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.155485 Jan 31 17:07:45.592091 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 45/96] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:45 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:45.630532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:45.631228 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:45.637087 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.637565 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.638395 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.638867 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.767946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:45.775243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-21648459-69f3-4a08-8747-8bd5932ef1bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.154438 Jan 31 17:07:45.775804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 52/97] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:45 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:45.840514 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:45.841656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:45.848089 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.848605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.849411 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.849876 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.857439 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:45.858186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:45.863870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.864358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:45.865142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:45.865580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.052303 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.055432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.059555 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a8a55cd4-9b01-4f61-8ec7-eb20cf52603b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.222882 Jan 31 17:07:46.060402 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 46/98] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:45 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:46.064001 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.064371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:46.064985 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:46.065956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.067512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3f346b71-7a73-4b82-b113-574d3de6820e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.214034 Jan 31 17:07:46.068092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 53/99] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:45 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:46.070502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:46.070954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.071730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:46.072190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.200693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.207844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6b8e6fb6-d079-417e-a465-36b620148c3b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.146736 Jan 31 17:07:46.208448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 47/100] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:46 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:46.609865 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:46.610510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:46.616402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:46.616859 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.617640 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:46.618110 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.754769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.761995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b279e5d6-df4b-49e9-a525-c975ee0a01ac tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.157131 Jan 31 17:07:46.763261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 54/101] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:46 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:46.791350 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:46.791966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:46.797914 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:46.798372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.799151 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:46.799623 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:46.929993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:46.937954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-967ef946-62f4-4274-9ba7-cb907c55b1f4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.150299 Jan 31 17:07:46.938530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 48/102] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:46 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:47.078515 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:47.079132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:47.085147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.085288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:47.085602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.085806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:47.086387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.086833 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.091997 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.092519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.093352 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.093803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.284350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:47.287355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:47.292245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-93e751b4-8929-4a25-bf26-e55ccbb44819 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.217369 Jan 31 17:07:47.292813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 55/103] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:47 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:47.295735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:47.297267 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:47.297701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:47.298304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:47.298406 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0423882f-50de-4b77-b647-d0b760a8d5b5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.216904 Jan 31 17:07:47.299092 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 49/104] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:47 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:47.303904 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.304386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.305361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.305679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.439380 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:47.446707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-661f9536-2309-447f-ac3b-5a65b13819b3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.152934 Jan 31 17:07:47.447284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 56/105] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:47 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:47.778910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:47.782451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:47.796437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.796910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.797716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.798165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.956138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:47.956981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:47.963619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.964347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:47.965410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:47.966434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.083593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.092189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7dad6eee-8913-45cf-85da-4b155e52f5b7 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.317159 Jan 31 17:07:48.093115 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 50/106] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:47 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:48.166696 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.174083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-095daec4-73ee-4e98-8c0f-6517d695bb2c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.223998 Jan 31 17:07:48.174652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 57/107] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:47 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:48.311780 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:48.312339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:48.316324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:48.316931 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:48.318484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:48.318884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.319728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:48.320189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.323137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:48.323593 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.324396 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:48.324841 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.692318 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.695541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.701584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9a17097b-2bec-4e03-b380-d9cff2c36c39 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.394880 Jan 31 17:07:48.702383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 51/108] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:48 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:48.704724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.706382 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.706764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:48.707363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:48.707705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e1e79db7-852d-40ae-aadd-c975b1d2a262 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.395005 Jan 31 17:07:48.708514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 58/109] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:48 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:48.716092 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:48.716640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.717492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:48.718000 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:48.853037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:48.861173 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5c5ff2b2-5977-4fc4-9416-5c4f6b90be19 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.157615 Jan 31 17:07:48.861749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 52/110] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:48 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:49.109804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:49.110659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:49.116909 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.117295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.118084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.118525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.190721 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:49.191311 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:49.197113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.197568 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.198352 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.198792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.283118 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:49.290279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c7a03dc6-c621-4b0b-9ba4-60840a591ffa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.184604 Jan 31 17:07:49.290854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 59/111] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:49 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:49.359686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:49.367276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-45793a8c-1ac8-4f84-8e11-10bbf5b8cc93 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.180122 Jan 31 17:07:49.367771 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 53/112] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:49 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:49.718923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:49.719527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:49.725363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:49.725606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.725978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:49.726162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.726825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.727259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.732589 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.733047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.733839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.734280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.938118 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:49.940668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:49.945669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-192901b1-b8d9-4d53-a91c-7c01ec5df656 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.231003 Jan 31 17:07:49.946324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 60/113] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:49 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:49.948610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:49.950753 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:49.951657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:49.951861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0750745e-b23c-4d47-a28f-33a2353197f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.230142 Jan 31 17:07:49.952437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 54/114] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:49 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:49.952561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:49.958481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.958939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:49.959720 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:49.960182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.096067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:50.103278 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e66cf047-e9f4-46d7-9121-a4bd4da1df14 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.155945 Jan 31 17:07:50.103846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 61/115] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:49 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:50.306651 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:50.307286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:50.314347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.314799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.315581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.316013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.385491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:50.386254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:50.392484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.392946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.393776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.394217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.476883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:50.484770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a8d2b902-699b-4919-9ddc-3ece2f869bfb tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.181835 Jan 31 17:07:50.485349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 55/116] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:50 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:50.545342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:50.552550 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-02a06883-6229-46b1-bcdd-0c06b7123e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.171571 Jan 31 17:07:50.553321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 62/117] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:50 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:50.962405 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:50.963017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:50.968470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:50.969089 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.969204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:50.969545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.970332 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.970770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.974898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.975352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:50.976158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:50.976604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.169806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.175992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.179201 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d316908a-5f4b-4a7f-bf2d-d03b75ea8731 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.220303 Jan 31 17:07:51.189050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 56/118] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:50 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:51.189050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:51.189050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:51.192440 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:51.192961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.193818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:51.194327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.194445 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.195896 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.197044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ad66a26b-327d-4123-a6d9-93576f5ae952 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.232249 Jan 31 17:07:51.199178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 63/119] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:50 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:51.335539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.343705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8d3fd99e-5866-4def-8a68-3ac9cb6a9069 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.162452 Jan 31 17:07:51.344251 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 57/120] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:51 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:51.502478 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:51.503091 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:51.508905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:51.509356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.510137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:51.510573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.572453 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:51.572982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:51.579122 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:51.579577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.580399 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:51.580838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:51.679343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.690075 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-192bf8de-e9bb-459d-b961-a575294a98fa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.189442 Jan 31 17:07:51.696975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 64/121] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:51 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:51.745983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:51.753745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5543ad4c-011b-4cd7-80e6-973d613328a4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.188163 Jan 31 17:07:51.754376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 58/122] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:51 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:52.196411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:52.197017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:52.203232 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.203676 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.204484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.204917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.214729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:52.215569 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:52.221872 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.222371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.223203 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.223683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.405988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.409341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.413433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1c5c70e7-37b8-4c86-8d0a-64070f204915 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.220579 Jan 31 17:07:52.413999 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 65/123] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:52 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:52.417237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.418154 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:52.419258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.420041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:52.420422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e6d5d627-b623-4abb-a947-49fddedf6337 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.209613 Jan 31 17:07:52.421118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 59/124] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:52 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:52.425670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.426113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.426881 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.427311 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.560225 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.567479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-768b8c3f-6a1b-4cc4-9cbb-b4feee05e236 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.152482 Jan 31 17:07:52.568059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 66/125] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:52 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:52.704322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:52.704943 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:52.710785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.711235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.712009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.712471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.770353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:52.771029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:52.776741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.777192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.778637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:52.779434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:52.878509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.885708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-707fff84-ecf9-4187-861d-714f1a077fd2 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.185034 Jan 31 17:07:52.886284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 60/126] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:52 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:52.943353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:52.951115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-774e640c-96c0-4ac3-bf51-b4db391a9816 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.184412 Jan 31 17:07:52.951667 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 67/127] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:52 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:53.429985 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:53.430596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:53.436854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.437309 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.437663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:53.438087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.438302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:53.438525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.444168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.444627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.445410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.445852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.636004 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:53.640037 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:53.644013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-01b38a83-6125-46f8-a31b-c2b48fdcb259 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.217642 Jan 31 17:07:53.644642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 61/128] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:53 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:53.647863 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:53.648837 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:53.649402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:53.649518 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:53.650501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ba360061-a509-4768-87d3-41dbdc825ff8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.216563 Jan 31 17:07:53.652365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 68/129] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:53 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:53.655933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.656415 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.657280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.657727 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.785610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:53.792797 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0904703c-c142-4173-a921-9f499cdf0d9e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.147207 Jan 31 17:07:53.793368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 62/130] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:53 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:53.902921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:53.903544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:53.909802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.910283 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.911149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.911605 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.968512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:53.969117 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:53.975029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.975477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:53.976281 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:53.976713 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.079443 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:54.095252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ef2d2d83-a75b-4945-822d-9f4ebbd707d8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.195889 Jan 31 17:07:54.096131 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 69/131] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:53 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:54.145503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:54.152777 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a26059d3-69fa-4d93-a744-261440ada0cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.188883 Jan 31 17:07:54.154093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 63/132] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:53 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:54.660785 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:54.661394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:54.667441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:54.667894 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.668701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:54.668810 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:54.669203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.669334 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:54.675076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:54.675524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.676330 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:54.676772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.865600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:54.873098 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9ae7c279-ed6a-4f2d-8925-d0c9295ce2c8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.216070 Jan 31 17:07:54.873679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 70/133] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:54 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:54.877340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:54.878226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:54.878839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:54.884799 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:54.885262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.886039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:54.886383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:54.886508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:54.887927 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:54.889120 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1be15f60-c08a-422f-b88f-323fd5cac98f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.224023 Jan 31 17:07:54.889703 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 64/134] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:54 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:55.019361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:55.026584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a4d610ab-5d51-4db7-9092-e31686a91126 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.151968 Jan 31 17:07:55.027150 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 71/135] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:54 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:55.113163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:55.120180 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:55.127649 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.128082 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.136732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.136732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.171180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:55.172080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:55.181658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.182114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.182911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.183349 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.367552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:55.377735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-caf7c20a-e778-4e63-9b4a-700853f311c5 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1314 microversion: 2.1 time: 0.268409 Jan 31 17:07:55.386979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 65/136] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:55 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:55.520497 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:55.528386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b5ef0d7e-68c7-49c3-82ee-65691ff58dcc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.361910 Jan 31 17:07:55.539094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 72/137] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:55 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:55.710075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-ecaa36a8-c2f8-40d4-815f-c7d64a9eb557 req-00938b37-16d1-44b7-afab-5bfeb6454219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578b3d82-02e9-4759-b0e3-ad4ff650a4c4", "name": "network-vif-plugged", "status": "completed", "tag": "e6a7874f-beac-4e94-88c7-ad9d8063cb4a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:55.714036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:07:55.714036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:07:55.725825 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ecaa36a8-c2f8-40d4-815f-c7d64a9eb557 req-00938b37-16d1-44b7-afab-5bfeb6454219 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.727387 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ecaa36a8-c2f8-40d4-815f-c7d64a9eb557 req-00938b37-16d1-44b7-afab-5bfeb6454219 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.741119 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-ecaa36a8-c2f8-40d4-815f-c7d64a9eb557 req-00938b37-16d1-44b7-afab-5bfeb6454219 service nova] Creating event network-vif-plugged:e6a7874f-beac-4e94-88c7-ad9d8063cb4a for instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 on hv-cinder-81566 Jan 31 17:07:55.746400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-ecaa36a8-c2f8-40d4-815f-c7d64a9eb557 req-00938b37-16d1-44b7-afab-5bfeb6454219 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041735 Jan 31 17:07:55.747673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 66/138] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:55.890562 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:55.891190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:55.897732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.898403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.899261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.899718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.909656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:55.910579 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:55.918190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.919537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:55.920482 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:55.921146 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.272822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.281077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a7b3b4c1-2a96-4564-9751-66de4a7f18fc tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.394832 Jan 31 17:07:56.282133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 73/139] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:55 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:56.286811 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:56.287418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:56.292675 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.293323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:56.294530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.295710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:56.296871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.303805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.308190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.309527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c3eb3c82-6a31-41ea-80cb-99d01f0d2a1f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.405271 Jan 31 17:07:56.310153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 67/140] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:55 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:56.397903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:56.402142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:56.409585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:56.410356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.411139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:56.411583 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.500514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.510269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9e1516ab-5112-48ef-9682-6f6648e61c10 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1317 microversion: 2.1 time: 0.226675 Jan 31 17:07:56.511060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 74/141] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:56 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:56.549351 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:56.550199 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:56.569449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:56.569988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.570747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:56.571192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:56.579549 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.587149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2752ef30-9abc-40c2-a396-1df8dea34328 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1500 microversion: 2.1 time: 0.193204 Jan 31 17:07:56.592930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 68/142] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:56 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1500 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:56.720740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:56.727948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-49b47811-ff86-4ecc-8f3f-e9ef7ee723fc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1322 microversion: 2.1 time: 0.185146 Jan 31 17:07:56.728556 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 75/143] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:56 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:57.298735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:57.300159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:57.306778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.307222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.308032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.308501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.328254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:57.329434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:57.335335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.335768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.336766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.337204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.531426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:57.539874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:57.546712 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fc5cb881-ce67-41d7-a515-bf96e98743f8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.250584 Jan 31 17:07:57.549187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 69/144] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:57 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:57.557219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:57.558041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:57.565111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:57.566187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.566819 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.567031 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:57.568143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.568473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cb577394-ecb7-48db-a88c-9cda32b932aa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.245079 Jan 31 17:07:57.569422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.569530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 76/145] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:57 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:07:57.746997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:57.747661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:57.754600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.755327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:57.756718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:57.757409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.006545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.011787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.019586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1bbf72d9-8137-4a8c-bc29-4cb603874e7e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1516 microversion: 2.1 time: 0.277409 Jan 31 17:07:58.020165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 77/146] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:57 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:58.027017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0c291132-1e67-480b-9fb6-ceed2be8ec44 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1506 microversion: 2.1 time: 0.476450 Jan 31 17:07:58.028575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 70/147] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:57 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:58.039226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:58.040401 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:58.047383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.047838 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.048849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.049331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.117344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lazy-loading 'flavor' on Instance uuid bd43f047-fa56-444b-8a9b-7d654a7c2ffa {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:07:58.375140 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6dd35fc4-bc6b-4b3e-b177-561f7fe80c0c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa/action" status: 200 len: 32 microversion: 2.1 time: 0.339768 Jan 31 17:07:58.380828 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 78/148] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:07:58 2022] POST /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 17:07:58.385654 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:58.386270 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:58.393426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.393875 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.394854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.395442 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.567035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:58.567729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:58.573973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.574421 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.576582 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.577022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.597098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.605346 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-057dd385-e774-42d8-9cce-6224a211fdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.223334 Jan 31 17:07:58.606127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 71/149] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:58 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:58.610731 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:58.611463 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:58.617369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.617824 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.618600 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:58.619042 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:58.941376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.952820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-04140078-1430-480a-b7f5-45cc227c8e37 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1364 microversion: 2.1 time: 0.389598 Jan 31 17:07:58.956147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 79/150] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:58 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1364 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:07:58.963606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.972584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.974166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:58.975863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0f47198b-9427-48b6-bf81-2d58a7553cf5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.368183 Jan 31 17:07:58.977222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 72/151] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:07:58 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:07:59.012782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "183e5b57-ebef-42c2-84e3-34c79db96b20"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:59.014258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:59.020418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.020874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.021672 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.022112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.440783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1d6485f3-baa7-4b3f-b3e7-42c26caca4e4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "POST /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431629 Jan 31 17:07:59.444164 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 80/152] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:07:59 2022] POST /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:07:59.572340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21b6f8cf-e7f6-45b5-961b-40728db95392"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:07:59.573475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:59.580205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.580662 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.581444 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.581889 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.625113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:59.626005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:59.633660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.634345 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.635985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.636795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.808682 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:07:59.819056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2f9514d8-da1e-4c44-a4c8-971b34c37341 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.199213 Jan 31 17:07:59.820149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 81/153] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:59 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:07:59.970276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:07:59.971003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:07:59.981606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.982179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:07:59.984083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:07:59.988541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:00.141415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:00.149713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0871160b-dde2-4c10-93b5-589675ebec7a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1549 microversion: 2.1 time: 0.183214 Jan 31 17:08:00.150587 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 82/154] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:07:59 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:00.155726 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:00.156362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:00.162127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:00.162575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:00.163756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:00.164240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:00.326267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:00.346369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:00.349216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:00.350493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-90f818b5-48b2-4eee-a889-7c592bf18ec0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.198967 Jan 31 17:08:00.364333 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 83/155] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:00 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:00.373470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:00.374387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:00.380884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:00.381457 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:00.382363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:00.382918 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:00.485221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-256ada4b-7040-43ec-819a-c592da00029a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119774 Jan 31 17:08:00.486411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 84/156] 10.222.0.91 () {58 vars in 1274 bytes} [Mon Jan 31 17:08:00 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:00.546098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d5a063f1-f8d2-46ee-bc7f-430316f6e7b6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977506 Jan 31 17:08:00.548252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 73/157] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:07:59 2022] POST /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:00.837988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:00.838766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:00.844820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:00.845372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:00.846248 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:00.846769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:01.239826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:01.252189 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a590228b-e3c3-4070-b473-337928314d7d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.417861 Jan 31 17:08:01.260307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 85/158] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:00 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:01.372702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:01.373493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:01.389707 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:01.389812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:01.390617 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:01.390977 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:01.757034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-a5696fc6-5229-4ad1-8ee2-9d90c0eccffe req-53d890de-7b2a-4009-857a-aaa07fed7b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "name": "network-vif-plugged", "status": "completed", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:01.760377 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:01.760377 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:08:01.773374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a5696fc6-5229-4ad1-8ee2-9d90c0eccffe req-53d890de-7b2a-4009-857a-aaa07fed7b5c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:01.774171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a5696fc6-5229-4ad1-8ee2-9d90c0eccffe req-53d890de-7b2a-4009-857a-aaa07fed7b5c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:01.790462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-a5696fc6-5229-4ad1-8ee2-9d90c0eccffe req-53d890de-7b2a-4009-857a-aaa07fed7b5c service nova] Creating event network-vif-plugged:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:08:01.798557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-a5696fc6-5229-4ad1-8ee2-9d90c0eccffe req-53d890de-7b2a-4009-857a-aaa07fed7b5c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046686 Jan 31 17:08:01.800207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 86/159] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:08:01.810226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:01.824059 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:01.825791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:01.827696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f16a891e-1b1e-430b-a75d-c4321efb06f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.459806 Jan 31 17:08:01.828920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 74/160] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:01 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:02.230464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:02.231888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:02.242902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-c4ead222-3a8b-49ca-8df9-1bcf858b6e75 req-91c0277b-5f62-408a-9b0e-32913975a2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578b3d82-02e9-4759-b0e3-ad4ff650a4c4", "tag": "e6a7874f-beac-4e94-88c7-ad9d8063cb4a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:02.244505 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:02.244505 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:08:02.254657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.255130 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:02.255937 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.256401 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:02.259038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-c4ead222-3a8b-49ca-8df9-1bcf858b6e75 req-91c0277b-5f62-408a-9b0e-32913975a2e6 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.260916 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-c4ead222-3a8b-49ca-8df9-1bcf858b6e75 req-91c0277b-5f62-408a-9b0e-32913975a2e6 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:02.283796 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-c4ead222-3a8b-49ca-8df9-1bcf858b6e75 req-91c0277b-5f62-408a-9b0e-32913975a2e6 service nova] Creating event network-changed:e6a7874f-beac-4e94-88c7-ad9d8063cb4a for instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 on hv-cinder-81566 Jan 31 17:08:02.290528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-c4ead222-3a8b-49ca-8df9-1bcf858b6e75 req-91c0277b-5f62-408a-9b0e-32913975a2e6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051099 Jan 31 17:08:02.291746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 75/161] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:08:02.299297 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:02.300436 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:02.308221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.309231 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:02.310737 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.311415 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:02.552712 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:02.555651 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:02.564484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a381c44b-803d-49df-9c60-37c705eefce3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.269617 Jan 31 17:08:02.564807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-30f142b6-3734-452e-9a09-904be525d406 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1549 microversion: 2.1 time: 0.338058 Jan 31 17:08:02.565728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 87/162] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:02 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1549 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:02.566505 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 76/163] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:02 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:02.846410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:02.847037 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:02.852915 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.853599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:02.854862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:02.855491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:03.020533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:03.029902 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:03.031989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:03.033431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cfe76518-89a6-4de8-bf82-8af98db8ca0e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.190864 Jan 31 17:08:03.046970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 88/164] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:02 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:03.582246 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:03.582427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:03.582868 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:03.583627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:03.589060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:03.589515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:03.589776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:03.590298 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:03.590495 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:03.591153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:03.591279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:03.591689 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:03.824594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:03.827884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:03.836131 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a1d4e184-e404-4639-b939-b8c1d150d2e8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.257519 Jan 31 17:08:03.836702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 77/165] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:03 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:03.839711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-aa8bf7e8-e8f4-4190-9cb5-2f2cdba9b659 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1549 microversion: 2.1 time: 0.261104 Jan 31 17:08:03.840876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 89/166] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:03 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1549 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:04.051710 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:04.052355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:04.058219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:04.058685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:04.059608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:04.060052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:04.193675 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:04.202166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:04.203657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:04.204796 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1e57afcf-48d7-4b97-aaac-51ddce8a3d3f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.156765 Jan 31 17:08:04.205380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 78/167] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:04 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:04.853384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:04.854104 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:04.861041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:04.861441 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:04.861886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:04.862353 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:04.862534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:04.863163 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:04.870104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:04.870622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:04.871545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:04.872359 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:05.064153 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:05.071643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6884c589-5c5a-49c8-a803-89959cbc9432 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.221982 Jan 31 17:08:05.072391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 90/168] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:04 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:05.074952 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:05.082501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2b577458-e741-4e48-9b97-d671dd1ff289 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1549 microversion: 2.1 time: 0.229204 Jan 31 17:08:05.083066 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 79/169] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:04 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:05.221785 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:05.222399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:05.228314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:05.228775 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:05.229560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:05.230000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:05.360260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:05.367886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:05.369409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:05.370499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f8f66eaf-d8ea-4844-9be2-f100cf195b48 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.152385 Jan 31 17:08:05.371064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 91/170] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:05 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:06.089159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:06.089772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:06.096207 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:06.096690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:06.097474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:06.097915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:06.099698 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:06.100340 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:06.106656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:06.107107 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:06.107885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:06.108350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:06.297507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:06.301228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:06.304976 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7ede840d-3bae-44e7-95ff-be09f9363556 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1549 microversion: 2.1 time: 0.208996 Jan 31 17:08:06.305616 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 92/171] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:06 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:06.309163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-116015a7-b391-4be3-9d6a-b259c80d27f9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.223194 Jan 31 17:08:06.309990 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 80/172] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:06 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:06.389065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:06.389679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:06.395496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:06.395983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:06.396812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:06.397256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:06.529203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:06.536863 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:06.538361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:06.539496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c7700c9d-16cb-4fe5-a2d4-743bd92007b8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.154276 Jan 31 17:08:06.540054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 93/173] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:06 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:07.325046 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:07.326241 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:07.326595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:07.327212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:07.332213 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:07.332744 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:07.333546 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:07.333980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:07.334606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:07.335144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:07.336826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:07.337493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:07.618849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:07.622626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:07.627029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f944934a-a6cf-42a0-8c60-3e9cd802d6cd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.304306 Jan 31 17:08:07.628091 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 94/174] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:07 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:07.630715 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9b6b71d8-6f0a-4eef-826b-3d11fb8304e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1549 microversion: 2.1 time: 0.311363 Jan 31 17:08:07.631544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 81/175] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:07 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1549 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:07.632603 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:07.633243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:07.639158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:07.639608 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:07.640533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:07.640970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:07.774993 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:07.783206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:07.784731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:07.785822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-10812833-2fc3-45fd-872e-32f243d5baff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1405 microversion: 2.20 time: 0.156745 Jan 31 17:08:07.786375 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 95/176] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:07 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:08.658510 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:08.660086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:08.662423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:08.664452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:08.681324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.685320 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.687480 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.687978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.689030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.689475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.691061 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.692157 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.926610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:08.929452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:08.935036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-42e6220d-57b4-4671-95a7-4db79ec35230 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.294189 Jan 31 17:08:08.935630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 82/177] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:08 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:08.940126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:08.940781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:08.942269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-eb372c47-a69d-4328-a92c-7dd6452131c5 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1666 microversion: 2.1 time: 0.299473 Jan 31 17:08:08.943022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 96/178] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:08 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1666 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:08.946451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.946911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.947694 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.948162 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.957825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:08.958320 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:08.963935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.964429 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.965834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:08.966293 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:08.990378 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-88fae5d6-28a3-4ce8-babe-c67a9a410b47 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/ips" status: 200 len: 143 microversion: 2.1 time: 0.035980 Jan 31 17:08:08.990961 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 97/179] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Jan 31 17:08:08 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/ips => generated 143 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:08:09.082193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:09.090645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:09.092260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:09.093536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-72640927-1fa3-4496-93da-8a862801b142 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1598 microversion: 2.20 time: 0.156795 Jan 31 17:08:09.099240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 83/180] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:08 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:09.112324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:09.112820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:09.119409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:09.119900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:09.121133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:09.121756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:09.205727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-18b3ff4d-b7fe-47b0-9e7f-5d2d4c174425 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097414 Jan 31 17:08:09.206368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 98/181] 10.222.0.91 () {60 vars in 1315 bytes} [Mon Jan 31 17:08:09 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:08:09.958193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:09.958801 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:09.969163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:09.971424 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:09.972447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:09.973998 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:10.259442 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:10.267493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8b2f3248-e627-4398-be29-821133f50972 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.320164 Jan 31 17:08:10.268289 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 84/182] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:09 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:10.503828 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:10.504420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:10.505544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-583decdc-fcda-4610-9eb9-897656609f1e req-661f192a-c365-468c-84b1-02740951d712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:10.508626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:10.508626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:08:10.510643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:10.511137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:10.512197 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:10.512485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:10.520469 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-583decdc-fcda-4610-9eb9-897656609f1e req-661f192a-c365-468c-84b1-02740951d712 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:10.522174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-583decdc-fcda-4610-9eb9-897656609f1e req-661f192a-c365-468c-84b1-02740951d712 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:10.557226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-583decdc-fcda-4610-9eb9-897656609f1e req-661f192a-c365-468c-84b1-02740951d712 service nova] Creating event network-changed:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:08:10.598693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-583decdc-fcda-4610-9eb9-897656609f1e req-661f192a-c365-468c-84b1-02740951d712 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097297 Jan 31 17:08:10.603060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 85/183] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:08:10.750397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:10.778027 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:10.781450 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:10.782657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-91451526-5ebc-45a4-abb5-bea9684a0ba7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1598 microversion: 2.20 time: 0.283394 Jan 31 17:08:10.783580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 99/184] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:10 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1598 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:11.287742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:11.288520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:11.298853 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.303414 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.305626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.306279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.378804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:11.381755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:11.392562 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.393014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.393998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.394444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.424026 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Going to try to terminate instance {{(pid=116483) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:08:11.555411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fe202d97-90b2-42f6-8374-418dbd10c1ca tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "DELETE /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 204 len: 0 microversion: 2.1 time: 0.179930 Jan 31 17:08:11.560599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 100/185] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:08:11 2022] DELETE /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 17:08:11.571728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:11.573680 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:11.594637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.595187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.596049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.596529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.710478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:11.718888 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5c9f8971-3695-4b0c-a1c6-efd535d99acf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.434965 Jan 31 17:08:11.719478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 86/186] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:11 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:11.802140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:11.803445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:11.813326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.813782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.814596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:11.815043 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:11.865371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:11.876132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d7c81f56-d094-4311-a88c-8f06123bb5b6 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1552 microversion: 2.1 time: 0.313420 Jan 31 17:08:11.877302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 101/187] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:11 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1552 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:12.052744 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:12.065286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:12.067428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:12.069721 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ab0b9a0d-fdb3-4324-b077-c8ad30adb871 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1598 microversion: 2.20 time: 0.271449 Jan 31 17:08:12.070857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 87/188] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:11 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1598 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:08:12.737314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:12.738523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:12.745751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:12.747183 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:12.748178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:12.749042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:12.894632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:12.895395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:12.901708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:12.904770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:12.907952 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:12.908931 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:12.909144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-df9e53f6-78f5-46ba-a10d-35b41429b227 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.176567 Jan 31 17:08:12.909593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:12.909719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 102/189] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:12 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:13.069198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:13.079333 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-aa3fd4b8-d6e5-4707-a1e0-49fd80ebbf01 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1552 microversion: 2.1 time: 0.188318 Jan 31 17:08:13.080087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 88/190] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:12 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:13.089002 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:13.090197 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:13.095943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:13.096429 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:13.097212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:13.097649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:13.275119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:13.283906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:13.286546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:13.287717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cbf2f595-8ef0-439c-8bad-e7b0926d0074 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1717 microversion: 2.20 time: 0.203311 Jan 31 17:08:13.288299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 103/191] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:08:13 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1717 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:08:13.305514 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:13.306221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:13.312356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:13.312805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:13.313813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:13.314228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:13.492621 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-296c4027-57c3-45df-ba0e-090e8eaa43d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/ips" status: 200 len: 153 microversion: 2.20 time: 0.190685 Jan 31 17:08:13.493431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 89/192] 10.222.0.91 () {60 vars in 1288 bytes} [Mon Jan 31 17:08:13 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/ips => generated 153 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:08:13.927479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:13.928256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:13.935100 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:13.935756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:13.936918 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:13.937805 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:14.085517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:14.093456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fb0310e4-766c-42e2-b2e1-336fbe993650 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.169880 Jan 31 17:08:14.094042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 104/193] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:13 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:14.096291 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:14.096934 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:14.103374 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:14.103923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:14.104938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:14.105986 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:14.261803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:14.272214 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-01de718e-d8c1-496d-b19e-368c67fa7eda tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1552 microversion: 2.1 time: 0.179840 Jan 31 17:08:14.273277 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 90/194] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:14 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:15.111954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:15.113984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:15.122900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:15.124374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:15.129400 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:15.130399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:15.293890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:15.295180 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:15.307354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:15.308687 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:15.309954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:15.311332 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:15.437101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:15.446131 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-54dd7dcd-8a11-40ed-9cb6-0b1962de31d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.339499 Jan 31 17:08:15.458576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 105/195] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:15 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:15.590383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:15.613598 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e3446c12-e074-4e40-924c-13d091a5b01a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1552 microversion: 2.1 time: 0.326567 Jan 31 17:08:15.621997 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 91/196] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:15 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1552 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:16.463157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:16.463953 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:16.470970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:16.471429 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:16.472383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:16.472803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:16.641254 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:16.642113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:16.649764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:16.651286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:16.652346 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:16.652966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:16.880588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:16.894525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2a949671-c78c-48eb-89ef-c788125a2b6f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.435440 Jan 31 17:08:16.895635 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 106/197] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:16 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:17.040070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:17.048224 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f568474f-0cba-4f11-b90d-bd32ba282d56 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1552 microversion: 2.1 time: 0.412520 Jan 31 17:08:17.048790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 92/198] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:16 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1552 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:17.270699 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-2794dc5d-d6f6-4897-ad19-35551e877207 req-14596da3-ce18-41f2-83d1-934edd5e3a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd45ffd-1f91-4a04-9013-b2b497b37864", "name": "network-vif-deleted", "tag": "74552b91-d3a1-48c0-b8b0-43fe372bf46f"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:17.272506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:17.272506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:08:17.282983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-2794dc5d-d6f6-4897-ad19-35551e877207 req-14596da3-ce18-41f2-83d1-934edd5e3a34 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:17.283554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-2794dc5d-d6f6-4897-ad19-35551e877207 req-14596da3-ce18-41f2-83d1-934edd5e3a34 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:17.296663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-2794dc5d-d6f6-4897-ad19-35551e877207 req-14596da3-ce18-41f2-83d1-934edd5e3a34 service nova] Creating event network-vif-deleted:74552b91-d3a1-48c0-b8b0-43fe372bf46f for instance bcd45ffd-1f91-4a04-9013-b2b497b37864 on hv-cinder-81566 Jan 31 17:08:17.302198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-2794dc5d-d6f6-4897-ad19-35551e877207 req-14596da3-ce18-41f2-83d1-934edd5e3a34 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035191 Jan 31 17:08:17.302861 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 107/199] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:17.911023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:17.911791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:17.920113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:17.920655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:17.921538 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:17.921989 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:18.065583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:18.066935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:18.073844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:18.074801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:18.075621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:18.076066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:18.306649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:18.315694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c5ed931d-8b67-442d-aa84-e13d9355663a tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1345 microversion: 2.1 time: 0.254012 Jan 31 17:08:18.316547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 108/200] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:18 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1345 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:18.324218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:18.332130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-99f3e4d8-1480-4327-a33c-af6df1416500 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.424666 Jan 31 17:08:18.332698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 93/201] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:17 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:19.332977 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:19.333585 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:19.340431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:19.340888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:19.341669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:19.342109 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:19.348493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:19.349104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:19.355542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:19.356286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:19.357093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:19.357530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:19.376797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:19.377256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:19.377708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lazy-loading 'fault' on Instance uuid bcd45ffd-1f91-4a04-9013-b2b497b37864 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:08:19.442155 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9997283faf44fe814ad2dc5511ee48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '161162568607465d96fc8b944c451508', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:19.450594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a4b38937-829a-4505-9c6c-fd2520e4c7a3 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 200 len: 1350 microversion: 2.1 time: 0.121261 Jan 31 17:08:19.451172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 109/202] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:19 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 1350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:19.519046 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:19.526885 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1357749e-ac2e-475c-9ca8-a385a91635c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.181927 Jan 31 17:08:19.527640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 94/203] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:19 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:19.910413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2011788613", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "16fc1cee-4030-4155-ac8c-c75537e343ae"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:19.959601 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] validate_networks() for [('16fc1cee-4030-4155-ac8c-c75537e343ae', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:08:20.319602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:08:20.320052 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:08:20.320955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:08:20.321132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:08:20.321543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:08:20.330665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.331122 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.331921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.332386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.350896 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:08:20.354798 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for user d7d72db9dcc44391af4b1703b0e4377a and project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:08:20.366779 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:08:20.369406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:08:20.417321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6b8e4e18-0cdd-4ab9-ab8a-3a3c16c7ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510598 Jan 31 17:08:20.418132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 110/204] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:08:20.427818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a8581205-df44-4a42-b804-4a4ea74338d4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:20.428445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a8581205-df44-4a42-b804-4a4ea74338d4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:20.467713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:20.468443 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:20.474498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.475046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.475786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.476312 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.486039 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a8581205-df44-4a42-b804-4a4ea74338d4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:20.491927 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] HTTP exception thrown: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. Jan 31 17:08:20.492572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Returning 404 to user: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:08:20.493038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a8581205-df44-4a42-b804-4a4ea74338d4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1218 microversion: 2.1 time: 0.068842 Jan 31 17:08:20.493440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-32159724-14e5-4edd-8a7f-eabb622bd4aa tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 404 len: 111 microversion: 2.1 time: 0.030012 Jan 31 17:08:20.503475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 95/205] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:20 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:20.504279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 111/206] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:20 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:08:20.548077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:20.548919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:20.555419 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.555965 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.556972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.557595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.610753 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:20.611647 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:20.617579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.618261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.619267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:20.619922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:20.635954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] HTTP exception thrown: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. Jan 31 17:08:20.636688 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Returning 404 to user: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:08:20.637553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-729168cf-2a13-4095-8c30-3298232d5eb4 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030912 Jan 31 17:08:20.638272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 112/207] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:08:20 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:08:20.763590 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:20.775172 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-180c1dd1-cdc1-4c1a-85e8-b8dfa94438d0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.234696 Jan 31 17:08:20.775787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 96/208] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:20 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:21.510632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:21.511397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:21.517906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.518460 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.519356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.519869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.584774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:21.592796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e1264ccb-b9f9-4017-9598-8fe935ab47d1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1270 microversion: 2.1 time: 0.085818 Jan 31 17:08:21.593438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 113/209] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:21 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:21.791182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:21.791792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:21.798930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.799387 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.800205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.800653 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.862944 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:21.863577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:21.871571 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.872290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.873280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.873954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.888884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] HTTP exception thrown: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. Jan 31 17:08:21.889499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Returning 404 to user: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:08:21.890615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-179cab91-f001-4ac4-9a28-cd2296961122 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "DELETE /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 404 len: 111 microversion: 2.1 time: 0.031236 Jan 31 17:08:21.891259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 114/210] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:08:21 2022] DELETE /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:08:21.898842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:21.899452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] [instance: bcd45ffd-1f91-4a04-9013-b2b497b37864] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:21.905959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.906373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.907179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:21.907595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:21.921780 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] HTTP exception thrown: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. Jan 31 17:08:21.922684 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] Returning 404 to user: Instance bcd45ffd-1f91-4a04-9013-b2b497b37864 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:08:21.923352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d0be0ba7-b8a3-41b3-b30f-41192bef3fa8 tempest-DeleteServersTestJSON-124599493 tempest-DeleteServersTestJSON-124599493-project] 10.222.0.91 "GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864" status: 404 len: 111 microversion: 2.1 time: 0.028112 Jan 31 17:08:21.935674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 115/211] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:21 2022] GET /compute/v2.1/servers/bcd45ffd-1f91-4a04-9013-b2b497b37864 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:08:21.948087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:21.956643 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-104c9369-3347-42ad-a173-4d2f7b9de947 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.168970 Jan 31 17:08:21.967564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 97/212] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:21 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:22.610011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:22.610541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:22.616861 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:22.617333 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:22.618136 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:22.618578 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:22.695184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:22.700851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-81f9e6b9-39a2-4006-8a0c-8be4da583913 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1270 microversion: 2.1 time: 0.094410 Jan 31 17:08:22.701618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 116/213] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:22 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:22.974284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:22.974981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:22.982289 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:22.982828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:22.983698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:22.984283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:23.121586 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:23.129065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6174a935-e193-4904-b31e-9cb34eeabfa3 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.158752 Jan 31 17:08:23.129803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 98/214] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:22 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:23.718158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:23.719283 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:23.725361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:23.725845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:23.726671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:23.727116 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:23.792905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:23.800351 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c6df6402-1794-489b-accd-6f5ad2c5031d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1270 microversion: 2.1 time: 0.086814 Jan 31 17:08:23.800917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 117/215] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:23 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:24.146360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:24.146970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:24.153005 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:24.153471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:24.154286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:24.154729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:24.291484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:24.299826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-be01de9a-9968-4081-a044-e7fa804c80f1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.157282 Jan 31 17:08:24.300458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 99/216] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:24 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:24.817615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:24.818292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:24.825369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:24.825834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:24.826644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:24.827093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:24.888794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:24.896129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-dfe668a8-fc9e-40ba-b90c-a7c9cc64efea tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1270 microversion: 2.1 time: 0.082108 Jan 31 17:08:24.896708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 118/217] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:24 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1270 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:25.319173 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:25.319898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:25.328022 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:25.328500 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:25.329279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:25.329716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:25.479018 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:25.489334 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-107527e7-73a0-472f-ab2f-a23b967e3a8d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.174112 Jan 31 17:08:25.489919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 100/218] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:25 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:25.913974 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:25.914528 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:25.921367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:25.921829 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:25.922627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:25.923068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:26.010560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:26.018842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0c4c6696-6231-4637-a521-04c85ae1c71b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1276 microversion: 2.1 time: 0.108588 Jan 31 17:08:26.019499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 119/219] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:25 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:26.506776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:26.507645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:26.520397 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:26.520863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:26.524164 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:26.524672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:26.794783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:26.805285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bc1badcc-7c79-4410-a860-b50eb9bfb666 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.301313 Jan 31 17:08:26.814662 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 101/220] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:26 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:26.830200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1982046252", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:26.892436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] validate_networks() for None {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:08:27.036400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:27.037010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:27.043578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.044028 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.044884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.045373 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.337571 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:08:27.338030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:08:27.338447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:08:27.338885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:08:27.340061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:08:27.356208 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.356665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.357479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.357916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.374181 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:27.375247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Getting quotas for project f038eabe30d1481cb2586202edbffac6. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:08:27.380566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Getting quotas for user 19068866365e4adc90c52cd820f0a59b and project f038eabe30d1481cb2586202edbffac6. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:08:27.382195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ae5e0742-61f7-4387-9b4f-3b6f2e9272fd tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.349681 Jan 31 17:08:27.383235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 102/221] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:27 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:27.394481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:08:27.396682 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:08:27.442350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bd8fb38a-be04-4eac-8110-806adc494086 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615845 Jan 31 17:08:27.443003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 120/222] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:08:27.449530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-b21a2cab-d831-461f-aa21-36da08d7e7fd req-976994cb-4160-4ce7-8746-65f46dc17c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da00b7e-f9a6-4973-a402-aa55e327971b", "tag": "7d23fc7e-6d9a-44d4-b416-de0bb1353998"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:27.452048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:27.452048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:08:27.456518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cdc05285-e846-43c8-958a-38f9055ae110 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:27.457137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cdc05285-e846-43c8-958a-38f9055ae110 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:27.459792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-b21a2cab-d831-461f-aa21-36da08d7e7fd req-976994cb-4160-4ce7-8746-65f46dc17c88 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.460508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-b21a2cab-d831-461f-aa21-36da08d7e7fd req-976994cb-4160-4ce7-8746-65f46dc17c88 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.473646 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-b21a2cab-d831-461f-aa21-36da08d7e7fd req-976994cb-4160-4ce7-8746-65f46dc17c88 service nova] Creating event network-changed:7d23fc7e-6d9a-44d4-b416-de0bb1353998 for instance 4da00b7e-f9a6-4973-a402-aa55e327971b on hv-cinder-81566 Jan 31 17:08:27.486437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-b21a2cab-d831-461f-aa21-36da08d7e7fd req-976994cb-4160-4ce7-8746-65f46dc17c88 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047112 Jan 31 17:08:27.487350 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 103/223] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:08:27.521043 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cdc05285-e846-43c8-958a-38f9055ae110 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:27.530444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cdc05285-e846-43c8-958a-38f9055ae110 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1215 microversion: 2.1 time: 0.080445 Jan 31 17:08:27.530999 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 121/224] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:27 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:27.823170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:27.824828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:27.830854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.831314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.832114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:27.832562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:27.974337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:27.987076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c9a4bb5a-6e43-4248-9432-50c8bbf4c084 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.163474 Jan 31 17:08:27.987076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 104/225] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:27 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:28.400065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:28.400700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:28.408366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:28.408872 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:28.409796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:28.410434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:28.547824 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:28.548461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:28.554321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:28.554928 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:28.556002 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:28.556567 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:28.591856 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:28.601347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-58f6a4bb-cf4b-4df4-a7bc-6edbf0a26bcc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.204839 Jan 31 17:08:28.602432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 122/226] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:28 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:28.626804 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:28.634468 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8400e674-0e02-4407-b62d-4aed1c632adc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1219 microversion: 2.1 time: 0.090618 Jan 31 17:08:28.635099 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 105/227] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:28 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:28.998947 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:29.000332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:29.006574 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:29.007146 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:29.008049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:29.008613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:29.213303 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:29.222919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d25b9b18-029f-4de7-b6d1-6691712647fd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.228067 Jan 31 17:08:29.223504 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 123/228] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:28 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:29.618298 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:29.619135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:29.626931 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:29.627574 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:29.628480 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:29.629142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:29.652081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:29.653314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:29.659252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:29.659715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:29.660584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:29.661029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:29.730222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:29.740440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-12e9a772-81a1-4b9b-8787-3a6d5b69ee2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1219 microversion: 2.1 time: 0.091911 Jan 31 17:08:29.741136 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 124/229] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:29 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:29.797863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:29.805247 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ed62301b-4be9-42d4-8409-55fba4f153d2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.190498 Jan 31 17:08:29.805985 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 106/230] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:29 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:30.239849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:30.240501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:30.247396 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:30.247862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:30.248681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:30.249126 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:30.405929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:30.413430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2614ffe2-a358-4196-b4e9-61daff06407e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.177320 Jan 31 17:08:30.414062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 125/231] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:30 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:30.757814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:30.758403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:30.765172 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:30.765631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:30.766429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:30.766861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:30.823306 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:30.825269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:30.828327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:30.831074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:30.831531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:30.832367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:30.832937 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:30.835636 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-744c0092-fc02-47fb-9422-6c750f3c0924 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1219 microversion: 2.1 time: 0.082074 Jan 31 17:08:30.836218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 107/232] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:30 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:30.971238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:30.978418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-13e8fcca-5353-4ace-8f2d-89c7f5c0c76d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.159518 Jan 31 17:08:30.978973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 126/233] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:30 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:31.430778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:31.431593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:31.438215 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:31.438672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:31.439663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:31.440133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:31.856415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:31.859404 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:31.868702 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:31.869886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:31.871728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:31.872460 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:31.980815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:31.983069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:31.991388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-69149952-74ca-46ac-83ec-f865ce9379c0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1267 microversion: 2.1 time: 0.140854 Jan 31 17:08:31.994437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-de1ec7c6-611f-499b-acbf-585bca5bfc4e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.567447 Jan 31 17:08:31.995944 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 108/234] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:31 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:32.001150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:32.001773 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 127/235] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:31 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:32.002346 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:32.008179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:32.008631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:32.009624 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:32.010064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:32.190863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:32.199369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1d907713-c182-4325-841b-1eaafef9d222 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.201967 Jan 31 17:08:32.200262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 109/236] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:31 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:33.017300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:33.019725 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:33.020494 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:33.023422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:33.036231 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:33.038254 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:33.039301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:33.040565 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:33.041101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:33.055180 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:33.056362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:33.058885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:33.168886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:33.176046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0c517e4a-f015-4e30-afcd-eb86760b8a9f tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1273 microversion: 2.1 time: 0.171507 Jan 31 17:08:33.177237 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 128/237] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:33 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:33.217282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:33.218807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:33.225520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:33.226237 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:33.227268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:33.228335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:33.534537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:33.544827 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fa0e3ff0-27e2-4be9-b78a-125a1b13506f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.535279 Jan 31 17:08:33.554435 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 110/238] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:33 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:33.569588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:33.578384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3d09eafb-52b0-49d5-9ef6-526e5036a383 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.365547 Jan 31 17:08:33.579544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 129/239] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:33 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:34.193481 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:34.194342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:34.201495 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:34.201954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:34.203564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:34.204607 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:34.354279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:34.362101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c3f8b2c6-7cdb-45de-90d7-61b7c6e20a6c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.172261 Jan 31 17:08:34.362676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 111/240] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:34 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:34.563155 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:34.563767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:34.570214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:34.570715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:34.571643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:34.572088 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:34.598316 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:34.598938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:34.606728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:34.607343 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:34.608717 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:34.609241 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:34.786264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:34.796681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1ee22963-8a16-4047-9567-444daf0d5e3a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.237212 Jan 31 17:08:34.797279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 130/241] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:34 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:34.806733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:34.806733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dada5d3e-4c2e-46ad-890d-7915624a7b7a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.214435 Jan 31 17:08:34.806733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 112/242] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:34 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:35.378861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:35.379689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:35.386664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:35.387123 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:35.387917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:35.388381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:35.530105 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:35.537405 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4ea07751-9b89-484a-9132-9e420cf206fd tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.162595 Jan 31 17:08:35.537968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 113/243] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:35 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:35.815710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:35.816573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:35.822394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:35.823423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:35.825913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:35.826372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:35.827162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:35.827608 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:35.829943 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:35.830574 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:35.831366 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:35.831802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:36.034333 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:36.035655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:36.039925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8e39cc00-c0d5-439b-8f97-2d0df00aeff9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.227952 Jan 31 17:08:36.040529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 131/244] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:35 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:36.046043 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f634c8a3-bdf7-4e2a-88b6-3139e53711f0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.227479 Jan 31 17:08:36.047376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 114/245] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:35 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:36.553313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:36.553923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:36.560596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:36.561347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:36.562158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:36.562600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:36.710050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:36.718019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-79647d23-6ab2-41ce-9252-99ceb82ac8f5 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.168179 Jan 31 17:08:36.718599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 132/246] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:36 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:37.056317 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:37.058295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:37.062483 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:37.063126 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:37.065111 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.065806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.067372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.068030 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.070586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.071046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.072267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.072880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.446433 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:37.453907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ac787f0b-977e-4340-b8ad-c1a02ce9b092 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.401215 Jan 31 17:08:37.454957 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 115/247] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:37 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:37.465979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:37.473890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-afb533c3-f82b-42d7-88c6-0fdfe9f35dae tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.415093 Jan 31 17:08:37.474471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 133/248] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:37 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:37.735536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:37.736274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:37.743155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.743620 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.744558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.745710 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.834369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-b0d69180-e2c4-4367-b012-debbf356d468 req-fd1794f7-d1a9-407e-8fe4-ec7c35361831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d32b0b6-8638-46ed-8ed0-43557be96554", "tag": "be603a38-372d-42b3-9b3d-0befc33b9041"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:37.836705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:37.836705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:08:37.847694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-b0d69180-e2c4-4367-b012-debbf356d468 req-fd1794f7-d1a9-407e-8fe4-ec7c35361831 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:37.848903 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-b0d69180-e2c4-4367-b012-debbf356d468 req-fd1794f7-d1a9-407e-8fe4-ec7c35361831 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:37.865928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-b0d69180-e2c4-4367-b012-debbf356d468 req-fd1794f7-d1a9-407e-8fe4-ec7c35361831 service nova] Creating event network-changed:be603a38-372d-42b3-9b3d-0befc33b9041 for instance 0d32b0b6-8638-46ed-8ed0-43557be96554 on hv-cinder-81566 Jan 31 17:08:37.880786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-b0d69180-e2c4-4367-b012-debbf356d468 req-fd1794f7-d1a9-407e-8fe4-ec7c35361831 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053003 Jan 31 17:08:37.881390 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 134/249] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:08:37.966192 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:37.975540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f9536300-203c-48f0-9df3-a1ae5ddedd2e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.243112 Jan 31 17:08:37.976714 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 116/250] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:37 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:38.473095 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:38.473823 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:38.483537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:38.483537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:38.483537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:38.483537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:38.491593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:38.492072 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:38.500396 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:38.500867 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:38.506688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:38.506688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:38.998961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:39.009290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d4ff05d6-c7d4-4285-bc44-669215380520 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.521620 Jan 31 17:08:39.012093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 117/251] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:38 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:39.014021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:39.022854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:39.023477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:39.027233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2dab8830-278e-4c26-aa0d-8a67f89ad8c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.558470 Jan 31 17:08:39.030323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:39.031308 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:39.032755 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:39.033684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:39.037526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 135/252] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:38 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:39.350025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:39.357819 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-60ed9f27-e32c-47b2-a595-d4bbc5546070 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.344368 Jan 31 17:08:39.358668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 118/253] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:39 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:40.028242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:40.028862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:40.035070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:40.035530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:40.036350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:40.036796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:40.044894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:40.045506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:40.051814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:40.052246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:40.053031 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:40.053474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:40.266959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:40.270813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:40.275172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-50d902a8-9672-4b47-9b62-467aff69dfb8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.251224 Jan 31 17:08:40.277878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-44633145-de36-4b8d-b705-013517e1f88f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.237426 Jan 31 17:08:40.278484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 119/254] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:40 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:40.288649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 136/255] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:40 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:40.375842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:40.376955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:40.382989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:40.383446 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:40.384258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:40.384809 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:40.518616 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:40.525896 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1631859d-841a-41ab-832e-5d86ff42fd41 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.154351 Jan 31 17:08:40.527508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 137/256] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:40 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:41.296127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:41.296786 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:41.297147 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:41.297240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:41.302785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:41.303237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:41.303881 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:41.304026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:41.304493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:41.304621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:41.305489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:41.306039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:41.507124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:41.510452 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:41.514812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-de095efc-1d32-4616-8440-f686bb040d2e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.222486 Jan 31 17:08:41.515475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 138/257] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:41 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:41.518508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d47771a3-3b72-4d31-8095-439ca7f406f6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.226282 Jan 31 17:08:41.519153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 120/258] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:41 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:41.542729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:41.543327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:41.549077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:41.549464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:41.550238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:41.550672 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:41.684356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:41.691561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-58c79988-adb8-4ca3-8578-fe31130847cf tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.152906 Jan 31 17:08:41.692156 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 139/259] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:41 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:42.531148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:42.531769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:42.535380 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:42.535993 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:42.538148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:42.538609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:42.539400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:42.539849 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:42.542283 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:42.542736 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:42.543519 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:42.543955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:42.740447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:42.743925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:42.748686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-89808446-040b-480b-87b6-f6608000d50d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.221188 Jan 31 17:08:42.749255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 121/260] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:42 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:42.753358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9d4d28a4-a90c-4241-a7b9-5ced9e389975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.221333 Jan 31 17:08:42.753789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:42.754171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 140/261] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:42 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:42.754383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:42.759940 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:42.760516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:42.761870 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:42.762305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:42.897877 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:42.906152 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5752259d-5ce1-4020-8e22-e5f788bef060 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.155937 Jan 31 17:08:42.906726 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 122/262] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:42 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:43.767581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:43.768236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:43.770319 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:43.770926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:43.774527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:43.774982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:43.775802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:43.776941 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:43.778308 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:43.778763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:43.779544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:43.779978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:43.974522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:43.977622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:43.982806 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-98a3b542-6379-41d6-876b-df6f59492f31 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.218946 Jan 31 17:08:43.983386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 141/263] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:43 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:43.986263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ec127873-d4a6-4c37-9a6e-bc274c4af037 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.219558 Jan 31 17:08:43.988499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:43.989102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:43.991963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 123/264] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:43 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:43.995955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:43.996452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:43.997240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:43.997683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:44.129919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:44.137223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d006b204-4470-422c-a70f-0ed51454ab38 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.152277 Jan 31 17:08:44.137791 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 142/265] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:43 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:44.999380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:44.999823 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:45.002876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:45.003478 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:45.006402 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:45.006863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:45.007654 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:45.008093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:45.009728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:45.010195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:45.011471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:45.011914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:45.217209 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:45.221012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:45.224789 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-38f03be6-ec56-4271-927e-276b61134c5a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.226005 Jan 31 17:08:45.225366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 143/266] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:44 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:45.228613 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-08191997-0ea2-4253-bc7c-09cc313b8117 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.233488 Jan 31 17:08:45.229819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:45.230430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:45.236149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:45.236609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:45.237398 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:45.237839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:45.238084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 124/267] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:44 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:45.371778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:45.379349 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-85c92355-2662-47ec-a8ed-27a1d5613d0d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.152980 Jan 31 17:08:45.379946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 144/268] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:45 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:46.242641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:46.243248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:46.244964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:46.245583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:46.249678 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:46.250124 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:46.251150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:46.251591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:46.252060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:46.252547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:46.253330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:46.253771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:46.453690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:46.456473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:46.461077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b47f93a5-0572-4dab-a091-4bef7697f855 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.222081 Jan 31 17:08:46.461762 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 125/269] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:46 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:46.464412 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3d704ea6-5728-4c37-9825-11cffb9b2e72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.222458 Jan 31 17:08:46.465150 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 145/270] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:46 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:46.466608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:46.467222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:46.472912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:46.473356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:46.474143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:46.474762 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:46.619239 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:46.628258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2441a6f3-921d-4427-b58b-c84556ec4d78 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.165629 Jan 31 17:08:46.628829 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 126/271] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:46 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:47.478274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:47.478885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:47.481809 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:47.482423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:47.485880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:47.486336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:47.487129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:47.487573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:47.488658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:47.489106 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:47.489887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:47.490321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:47.679220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:47.686056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:47.687226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1a70df52-7649-4e4d-9ac9-59b6a7ad0234 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.212721 Jan 31 17:08:47.687818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 146/272] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:47 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:47.693550 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:47.693888 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c922791a-0fe4-4600-9195-7d00cb511c22 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.216621 Jan 31 17:08:47.694148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:47.703829 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 127/273] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:47 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:47.703984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:47.703984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:47.703984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:47.703984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:47.835156 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:47.843145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ba3f411c-1b8c-4405-ba86-79dd9dfd5661 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.152888 Jan 31 17:08:47.843721 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 147/274] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:47 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:48.704020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:48.704743 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:48.710320 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:48.710948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:48.711352 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:48.711802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:48.712621 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:48.713056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:48.717719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:48.718182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:48.718998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:48.719435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:48.924968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:48.931406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:48.932305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7e058e70-2f79-4917-8d81-73b7c90ad754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.231856 Jan 31 17:08:48.933116 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 128/275] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:48 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:48.937444 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:48.938047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:48.939170 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-78735be7-c41c-4f1f-b8d3-cbf3911aff84 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.232424 Jan 31 17:08:48.939893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 148/276] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:48 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:48.943705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:48.944201 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:48.944970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:48.945412 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:49.076611 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:49.084127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a2074680-2378-45e2-b892-86e545a3c73e tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.150047 Jan 31 17:08:49.084691 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 129/277] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:48 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:49.326222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-647819776", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "5d1f695b-2d4d-4037-80ef-3ba6895b5237"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:49.377661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] validate_networks() for [('5d1f695b-2d4d-4037-80ef-3ba6895b5237', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:08:49.728769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:08:49.729482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:08:49.729952 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:08:49.730644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:08:49.731079 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:08:49.740851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:49.741245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:49.742059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:49.742499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:49.759271 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Getting quotas for project d9ff165bd619436cb3de649388117b10. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:08:49.763894 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Getting quotas for user 7c238df167884c2fa93569d4b231afcf and project d9ff165bd619436cb3de649388117b10. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:08:49.774455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:08:49.776779 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:08:49.820361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1e78be1a-23f6-4e8f-8e56-ee6da7242caf tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498739 Jan 31 17:08:49.821005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 149/278] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:08:49.831366 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9177078f-378c-499c-a18b-256476c9c7f3 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:49.831979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9177078f-378c-499c-a18b-256476c9c7f3 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:49.885854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9177078f-378c-499c-a18b-256476c9c7f3 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:49.892306 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9177078f-378c-499c-a18b-256476c9c7f3 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1213 microversion: 2.1 time: 0.064519 Jan 31 17:08:49.892866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 130/279] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:49 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:49.949490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:49.950135 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:49.955715 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:49.956268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:49.956394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:49.956725 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:49.957514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:49.958126 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:49.962519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:49.962983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:49.963832 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:49.964458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:50.171071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:50.179883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:50.180131 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c7a2a73d-0637-4bba-be99-08d036e71577 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.234331 Jan 31 17:08:50.180852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 150/280] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:49 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:50.186875 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:50.188177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:50.189235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6db9c7e3-19d4-4c2f-8d39-29f934fd7c17 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.237004 Jan 31 17:08:50.195141 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:50.195727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:50.196756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:50.197270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:50.200077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 131/281] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:49 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:50.348995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:50.357003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5fbfacdb-2bd7-4842-adfe-bef3fde9bdc3 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.174926 Jan 31 17:08:50.357583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 151/282] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:50 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:50.848090 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-47930f66-caf2-42a7-a15e-69833d3dde41 req-af538fbe-0d57-4165-b88f-d2516efb4edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da00b7e-f9a6-4973-a402-aa55e327971b", "name": "network-vif-plugged", "status": "completed", "tag": "7d23fc7e-6d9a-44d4-b416-de0bb1353998"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:50.849761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:50.849761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:08:50.858040 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-47930f66-caf2-42a7-a15e-69833d3dde41 req-af538fbe-0d57-4165-b88f-d2516efb4edc service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:50.858556 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-47930f66-caf2-42a7-a15e-69833d3dde41 req-af538fbe-0d57-4165-b88f-d2516efb4edc service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:50.871058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-47930f66-caf2-42a7-a15e-69833d3dde41 req-af538fbe-0d57-4165-b88f-d2516efb4edc service nova] Creating event network-vif-plugged:7d23fc7e-6d9a-44d4-b416-de0bb1353998 for instance 4da00b7e-f9a6-4973-a402-aa55e327971b on hv-cinder-81566 Jan 31 17:08:50.876176 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-47930f66-caf2-42a7-a15e-69833d3dde41 req-af538fbe-0d57-4165-b88f-d2516efb4edc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031434 Jan 31 17:08:50.876760 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 132/283] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:50.909520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:50.910286 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:50.918258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:50.919079 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:50.919526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:50.919964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:50.980762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:50.988487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8e0f427e-bfdf-4a80-8438-d046a28c01a2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1265 microversion: 2.1 time: 0.082650 Jan 31 17:08:50.989044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 152/284] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:50 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:51.196785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:51.197480 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:51.204127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:51.204584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:51.205363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:51.205747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:51.205857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:51.206363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:51.212092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:51.212584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:51.213948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:51.214479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:51.407535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:51.413971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:51.415218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f822cde1-5957-412b-b450-6209345b4ef6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.222269 Jan 31 17:08:51.416002 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 133/285] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:51 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:51.421043 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:51.421662 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:51.422241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d08586bf-3a62-474d-a5c6-3225231beaf2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.219933 Jan 31 17:08:51.423077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 153/286] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:51 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:51.435284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:51.435743 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:51.436577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:51.437026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:51.566983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:51.574808 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c2d6519f-47d3-4371-8f97-8142a7716554 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.157418 Jan 31 17:08:51.575307 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 134/287] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:51 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:52.005836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:52.006449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:52.013532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.013989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.014776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.015221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.073273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:52.080491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f684e15c-b4c3-407e-889b-e89d44dc965e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1265 microversion: 2.1 time: 0.078266 Jan 31 17:08:52.081063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 154/288] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:52 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:52.434272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:52.434909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:52.438660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:52.439268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:52.441255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.441716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.442780 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.443226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.445007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.445460 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.446228 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.446657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.653479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:52.656487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:52.660811 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2bac3221-207f-4db8-8298-fed7e6d80490 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.231111 Jan 31 17:08:52.661550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 135/289] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:52 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:52.663992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-66a3d7c5-94ac-4b72-a233-2942599da3a6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.228951 Jan 31 17:08:52.664729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 155/290] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:52 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:52.666065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:52.667280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:52.673277 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.673740 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.674524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:52.674966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:52.807550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:52.814688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-da95ea14-52d2-4f1d-9ef3-0da1ea00fc56 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.152283 Jan 31 17:08:52.815251 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 136/291] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:52 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:53.096736 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:53.097342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:53.103443 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.104444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.105491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.105929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.163741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:53.171272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b1c416f1-bf0f-4c73-a1ae-63e5b74650dc tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1265 microversion: 2.1 time: 0.078138 Jan 31 17:08:53.171834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 156/292] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:53 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:53.679140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:53.679753 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:53.681215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:53.681833 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:53.687209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.687669 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.688046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.688484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.688582 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.688926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.689308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.689750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.883125 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:53.887043 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:53.891238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-73159a0f-8f2f-493f-a87b-4b43ed6c66c1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.215700 Jan 31 17:08:53.891823 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 137/293] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:53 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:53.895050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-74567fb4-8515-4795-b4ce-ec00dcb2cedc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.217452 Jan 31 17:08:53.895878 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 157/294] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:53 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:53.896446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:53.897060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:53.903680 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.904164 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:53.904962 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:53.905408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.035077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:54.042251 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a264fb75-9dd4-4046-a5bb-d788e6d6bcb6 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.149456 Jan 31 17:08:54.042809 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 138/295] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:53 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:54.187668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:54.188251 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:54.194548 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.195008 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.195801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.196273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.256440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:54.263588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-68ee7086-f3fd-4b06-848a-548bd233c029 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1265 microversion: 2.1 time: 0.079645 Jan 31 17:08:54.264171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 158/296] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:54 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:54.505286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-88fe986c-b053-418e-ad12-a3a57aaf10b0 req-9c11390a-7f75-4429-b069-14122dd17cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d32b0b6-8638-46ed-8ed0-43557be96554", "name": "network-vif-plugged", "status": "completed", "tag": "be603a38-372d-42b3-9b3d-0befc33b9041"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:54.506838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:54.506838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:08:54.517642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-88fe986c-b053-418e-ad12-a3a57aaf10b0 req-9c11390a-7f75-4429-b069-14122dd17cef service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.518101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-88fe986c-b053-418e-ad12-a3a57aaf10b0 req-9c11390a-7f75-4429-b069-14122dd17cef service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.530782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-88fe986c-b053-418e-ad12-a3a57aaf10b0 req-9c11390a-7f75-4429-b069-14122dd17cef service nova] Creating event network-vif-plugged:be603a38-372d-42b3-9b3d-0befc33b9041 for instance 0d32b0b6-8638-46ed-8ed0-43557be96554 on hv-cinder-81566 Jan 31 17:08:54.536315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-88fe986c-b053-418e-ad12-a3a57aaf10b0 req-9c11390a-7f75-4429-b069-14122dd17cef service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035515 Jan 31 17:08:54.536907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 139/297] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:54.912242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:54.913026 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:54.918912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:54.919630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:54.919731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.920127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.920977 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.921427 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.926286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.926753 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:54.927561 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:54.928008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:55.120702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:55.123893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:55.128854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1e08d0df-c6a3-4e55-aea9-4bf9269175ab tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.214832 Jan 31 17:08:55.129430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 140/298] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:54 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:55.132083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5555fa2b-2fb8-448e-a2dd-cd7c6e607bf5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.223629 Jan 31 17:08:55.132824 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 159/299] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:54 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:55.133852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:55.134455 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:55.140029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:55.140516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:55.141317 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:55.141756 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:55.280075 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:55.280727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:55.287151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:55.287615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:55.288453 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:55.288902 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:55.392685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:55.397173 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:55.400306 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-90ca4d20-709e-45dd-b82c-6e42baea0f35 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.269791 Jan 31 17:08:55.401685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 141/300] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:55 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:55.408506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2db2097e-1c30-4606-826a-6f347d1eca9c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1283 microversion: 2.1 time: 0.132257 Jan 31 17:08:55.418448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 160/301] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:55 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:56.146256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:56.147086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:56.151406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:56.152069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:56.154846 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.155679 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.156645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.157435 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.158020 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.158479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.159272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.159879 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.473314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:56.476463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:56.482403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6fae4fa5-d778-4464-921c-7990aed099d4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.339784 Jan 31 17:08:56.482992 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 142/302] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:56 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:56.488034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:56.488747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:56.494564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.495342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.496266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.496713 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.498612 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ea13d6be-040c-432f-9094-e47fb0b82e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.351817 Jan 31 17:08:56.501284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 161/303] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:56 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:56.504142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:56.508766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:56.514724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.515184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.521233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:56.521975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:56.851410 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:56.859957 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5ebcbfd3-6c45-4420-b27e-d4639318d04d tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.375805 Jan 31 17:08:56.868494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 143/304] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:56 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:56.895647 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:56.903735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ced42dba-3a46-4706-a5fc-976510f7dfc6 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.403157 Jan 31 17:08:56.904358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 162/305] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:56 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:57.290750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-e03d27c9-5b1f-412b-accb-7180cc722eca req-f8ff33c8-505d-4533-b89f-9f7a29774300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f778b712-e488-4610-bef1-c235f1266d9d", "tag": "4b3ce0cf-d1a9-466a-bd18-bd3a7d991ade"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:57.293104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:08:57.293104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:08:57.300558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-e03d27c9-5b1f-412b-accb-7180cc722eca req-f8ff33c8-505d-4533-b89f-9f7a29774300 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.301010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-e03d27c9-5b1f-412b-accb-7180cc722eca req-f8ff33c8-505d-4533-b89f-9f7a29774300 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.314539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-e03d27c9-5b1f-412b-accb-7180cc722eca req-f8ff33c8-505d-4533-b89f-9f7a29774300 service nova] Creating event network-changed:4b3ce0cf-d1a9-466a-bd18-bd3a7d991ade for instance f778b712-e488-4610-bef1-c235f1266d9d on hv-cinder-81566 Jan 31 17:08:57.321203 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-e03d27c9-5b1f-412b-accb-7180cc722eca req-f8ff33c8-505d-4533-b89f-9f7a29774300 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033987 Jan 31 17:08:57.323074 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 144/306] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:57.499166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:57.499800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:57.506334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.506786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.507561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.507998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.517519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:57.518218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:57.524265 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.524724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.525527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.526549 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.790794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:57.798945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e2198715-4753-4cf9-b609-ff5a8c7eb1b5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.303381 Jan 31 17:08:57.799688 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 163/307] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:57 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:57.802782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:57.810772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1863e5c6-e8e5-4b90-bc93-719e66c21605 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1318 microversion: 2.1 time: 0.297097 Jan 31 17:08:57.811275 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 145/308] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:57 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:57.877021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:57.880037 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:57.888825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.889355 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.890184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.890638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.922142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:57.922775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:57.929026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.929485 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:57.930303 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:57.930751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:58.154757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:58.162893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1f34e079-69db-4221-9364-841aec837e4c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1315 microversion: 2.1 time: 0.289689 Jan 31 17:08:58.163569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 164/309] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:57 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:58.202982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:58.212072 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4e89048e-02a8-4289-8914-6c5f58b2c822 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.294216 Jan 31 17:08:58.226966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 146/310] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:57 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:58.815679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:58.816414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:58.824245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:58.824714 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:58.825527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:58.826103 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:58.828897 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:58.829592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:58.836686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:58.837209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:58.839096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:58.839722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.185383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:59.192766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6528ad6e-18e2-4612-bdde-f4a7fa7b3fad tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.380953 Jan 31 17:08:59.193944 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 165/311] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:58 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:59.195971 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:59.199797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:59.200755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.205537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-318411d3-259c-4738-b4d9-703689979220 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1508 microversion: 2.1 time: 0.379680 Jan 31 17:08:59.207261 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 147/312] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:58 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:08:59.207482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.208140 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.209048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.209566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.225344 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21b6f8cf-e7f6-45b5-961b-40728db95392"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:08:59.226895 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.233962 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.234686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.235767 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.236428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.329978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] HTTP exception thrown: Invalid volume: volume 21b6f8cf-e7f6-45b5-961b-40728db95392 is already attached to instances: b129cbbf-8ef7-494c-ac01-075b087f7cfc Jan 31 17:08:59.330663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Returning 400 to user: Invalid volume: volume 21b6f8cf-e7f6-45b5-961b-40728db95392 is already attached to instances: b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:08:59.331596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8c30486a-22bc-4cd2-8da4-fb9a1ddf1514 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110587 Jan 31 17:08:59.335728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 148/313] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:08:59 2022] POST /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 31 17:08:59.337633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:59.338930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.346676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.347323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.348258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.348773 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.381394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:59.395942 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8a33edc9-116d-40ec-85b8-6b4cdee871ed tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1465 microversion: 2.1 time: 0.200486 Jan 31 17:08:59.396712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 166/314] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:59 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1465 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:59.411195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:59.416842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.429370 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.429829 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.430636 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.431078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.534126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:59.541783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6d3766a8-7d44-476e-908f-3fc3ea573971 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.208217 Jan 31 17:08:59.543118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 149/315] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:59 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:08:59.548526 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:59.549268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.556069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.557361 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.558890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.559366 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.589649 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:08:59.613692 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'services' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:08:59.722134 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c32d7ddd-3f78-4004-aca6-40ff5fee15ac tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "DELETE /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 204 len: 0 microversion: 2.1 time: 0.174735 Jan 31 17:08:59.727332 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 150/316] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:08:59 2022] DELETE /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:08:59.738724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:59.739513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.746802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.747357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.748258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.748852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.792031 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a4866363-0830-4b2f-a2f4-d742be2bf930 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments/21b6f8cf-e7f6-45b5-961b-40728db95392" status: 202 len: 0 microversion: 2.1 time: 0.392968 Jan 31 17:08:59.793332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 167/317] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:08:59 2022] DELETE /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments/21b6f8cf-e7f6-45b5-961b-40728db95392 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:08:59.812402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:08:59.817739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:08:59.825042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.825506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.826314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:08:59.826938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:08:59.882081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1d4d590c-9caf-4a25-961c-e5cf58082e4f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074922 Jan 31 17:08:59.887097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 168/318] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:08:59 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:08:59.918797 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:08:59.927313 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fac4ca03-7a97-4216-ae9c-1c824ab9e477 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1471 microversion: 2.1 time: 0.193569 Jan 31 17:08:59.932675 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 151/319] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:08:59 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:00.210632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:00.211453 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:00.225551 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.226870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.229950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.231735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.383842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:00.392487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-95433db3-ea4d-4ef4-93c2-003091346f73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.186001 Jan 31 17:09:00.393069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 169/320] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:00 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:00.559885 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:00.560670 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:00.566881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.567345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.568171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.568622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.733834 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:00.741838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0418589d-10fa-4063-8831-f8c5bd8982f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.186557 Jan 31 17:09:00.742423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 152/321] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:00 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:00.893604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:00.895138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:00.902073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.902740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.903535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.903978 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.935647 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a83ce40c-a485-4b86-8f74-cf0cd154d3b8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045683 Jan 31 17:09:00.936235 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 170/322] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:09:00 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:00.949149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:00.950479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:00.956382 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.956849 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:00.957633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:00.958079 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.091231 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:01.098605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8f6e88f3-200e-430c-b070-35fd1b7b555c tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1471 microversion: 2.1 time: 0.153243 Jan 31 17:09:01.099165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 153/323] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:00 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:01.409664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:01.410663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:01.417511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:01.418407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.419767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:01.420481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.570772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:01.581076 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8f4c2bde-ff72-46db-8a92-7fbefd38a713 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.175233 Jan 31 17:09:01.582122 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 171/324] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:01 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:01.759464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:01.760809 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:01.771873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:01.772292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.773114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:01.773639 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.919947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:01.927483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c1d61411-d080-4ce8-80ed-1c6d02e07449 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.171637 Jan 31 17:09:01.928097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 154/325] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:01 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:01.946856 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:01.948422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:01.954567 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:01.955030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.955821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:01.956307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:01.986777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a9faf25a-f735-4edc-8160-6143c9f204c2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043698 Jan 31 17:09:01.987339 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 172/326] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:09:01 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:09:02.116735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:02.117596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:02.124003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.124787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.126002 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.126594 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.162558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1005834147", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "16fc1cee-4030-4155-ac8c-c75537e343ae"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:02.219245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] validate_networks() for [('16fc1cee-4030-4155-ac8c-c75537e343ae', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:09:02.326114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:02.334278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6f8ff1e9-cdc9-46e3-aad0-f1e711a7d8bc tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1471 microversion: 2.1 time: 0.221836 Jan 31 17:09:02.335124 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 155/327] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:02 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1471 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:02.598460 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:02.599265 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:02.607038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.607497 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.608331 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.608776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.673194 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:09:02.674187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:09:02.674821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:09:02.675404 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:09:02.676119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:09:02.688174 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.688923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.696001 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.696646 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.721067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:09:02.725127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for user d7d72db9dcc44391af4b1703b0e4377a and project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:09:02.737096 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:09:02.739344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:09:02.793256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:02.800440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-10e5cad1-70c2-4ab7-9ab3-01263100f1e1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641979 Jan 31 17:09:02.803737 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 173/328] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:09:02.810958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e634d809-2440-4ade-913f-962e3235305e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.216028 Jan 31 17:09:02.811543 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 156/329] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:02 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:02.814269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b2002ad6-63f6-4a79-9a9c-16f576bd61d6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:02.815297 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b2002ad6-63f6-4a79-9a9c-16f576bd61d6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:02.893905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b2002ad6-63f6-4a79-9a9c-16f576bd61d6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:02.901859 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b2002ad6-63f6-4a79-9a9c-16f576bd61d6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1218 microversion: 2.1 time: 0.094821 Jan 31 17:09:02.903002 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 174/330] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:02 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:02.948874 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:02.949600 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:02.957632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.958644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:02.959448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:02.960493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:03.225220 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:03.234817 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2a7c9c6c-6991-496a-b234-6022fe929c94 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.292193 Jan 31 17:09:03.235409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 157/331] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:02 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:03.351966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:03.352556 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:03.359753 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:03.360256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:03.361041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:03.361482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:03.496082 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:03.503577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b1b4620a-7362-4e44-8a4e-b399b9109890 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1471 microversion: 2.1 time: 0.155333 Jan 31 17:09:03.504151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 175/332] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:03 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:03.828711 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:03.829431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:03.836363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:03.836858 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:03.837779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:03.838238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:03.919068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:03.919886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:03.926794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:03.927252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:03.928144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:03.928752 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:04.003851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:04.009058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:04.013030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ff6f042b-76fb-4737-a6ac-2b0191860f9b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1222 microversion: 2.1 time: 0.097688 Jan 31 17:09:04.022233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 176/333] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:03 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:04.022994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a7994ce6-e899-4d09-bbf5-8e901d8e7b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.194223 Jan 31 17:09:04.022994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 158/334] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:03 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:04.253723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:04.254247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:04.260263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:04.260795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:04.261584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:04.262030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:04.395718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:04.403544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0e92f3b1-e58c-4c3f-a71f-e94520b69758 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.153733 Jan 31 17:09:04.404136 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 177/335] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:04 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:04.520393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:04.520938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:04.527499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:04.527959 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:04.528763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:04.529203 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:04.784426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:04.792429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4225f810-ca28-4e1b-b710-0e0e0dc29e02 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1471 microversion: 2.1 time: 0.275419 Jan 31 17:09:04.793050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 159/336] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:04 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:05.030733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:05.032428 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:05.037961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:05.037961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:05.045514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.046448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.046609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.047080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.047721 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.048351 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.051668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.052414 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.153169 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:05.162929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56dd0ae7-bfbb-44aa-a322-5e2cb9b5f9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1270 microversion: 2.1 time: 0.136652 Jan 31 17:09:05.164472 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 178/337] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:05 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1270 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:05.170559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-9f17fa5e-61e3-48c2-b38a-5844db19b05e req-b72991ae-43cb-498e-b4ad-c86c29697862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d32b0b6-8638-46ed-8ed0-43557be96554", "name": "network-vif-deleted", "tag": "be603a38-372d-42b3-9b3d-0befc33b9041"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:05.172596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:05.172596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:09:05.181047 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-9f17fa5e-61e3-48c2-b38a-5844db19b05e req-b72991ae-43cb-498e-b4ad-c86c29697862 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.182968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-9f17fa5e-61e3-48c2-b38a-5844db19b05e req-b72991ae-43cb-498e-b4ad-c86c29697862 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.204932 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-9f17fa5e-61e3-48c2-b38a-5844db19b05e req-b72991ae-43cb-498e-b4ad-c86c29697862 service nova] Creating event network-vif-deleted:be603a38-372d-42b3-9b3d-0befc33b9041 for instance 0d32b0b6-8638-46ed-8ed0-43557be96554 on hv-cinder-81566 Jan 31 17:09:05.211957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-9f17fa5e-61e3-48c2-b38a-5844db19b05e req-b72991ae-43cb-498e-b4ad-c86c29697862 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045354 Jan 31 17:09:05.213520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 179/338] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:05.290082 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:05.298405 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a24d450f-67d4-42f1-b3c1-65473ac8c746 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1522 microversion: 2.1 time: 0.265796 Jan 31 17:09:05.299474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 160/339] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:05 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:05.426591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:05.427077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:05.449670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.450129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.451885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.452364 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.674178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:05.685265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e9f27727-9f5a-4582-b1a9-0cc3a93c235b tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.262661 Jan 31 17:09:05.686693 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 180/340] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:05 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:05.812945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:05.813770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:05.821053 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.821704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.822933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.823537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.861408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:05.862183 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:05.862686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lazy-loading 'fault' on Instance uuid 0d32b0b6-8638-46ed-8ed0-43557be96554 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:09:06.174460 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19068866365e4adc90c52cd820f0a59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f038eabe30d1481cb2586202edbffac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:06.181986 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3191d9d0-ee02-49da-9074-88a6e525c3e0 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 200 len: 1305 microversion: 2.1 time: 0.374335 Jan 31 17:09:06.182564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 161/341] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:05 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 1305 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:06.190708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:06.191468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:06.198349 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.198802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.199601 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.200035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.274113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:06.284572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7516607f-d426-4ea1-8c34-62fdbd377e8d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1276 microversion: 2.1 time: 0.104167 Jan 31 17:09:06.285168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 181/342] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:06 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:06.323838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:06.324631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:06.331920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.332539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.333435 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.334256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.592629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:06.605341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5740b4d5-595d-4342-b747-2a8aa6262373 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1502 microversion: 2.1 time: 0.282065 Jan 31 17:09:06.606184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 162/343] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:06 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:06.634071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:06.636346 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:06.644437 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.645062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.646420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.647381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.705933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:06.707246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:06.723572 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.727376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.729084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.729770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.913375 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:06.923003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-67397af0-1fe1-449b-a8f2-2fbcba210e13 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1515 microversion: 2.1 time: 0.296216 Jan 31 17:09:06.936097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 182/344] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:06 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1515 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:06.936097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-4709f32a-2feb-44e5-8f51-9aa923920476 req-75aac906-81a9-4936-89f4-7aaf7490e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778b712-e488-4610-bef1-c235f1266d9d", "name": "network-vif-plugged", "status": "completed", "tag": "4b3ce0cf-d1a9-466a-bd18-bd3a7d991ade"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:06.936097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:06.936097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:09:06.948271 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-4709f32a-2feb-44e5-8f51-9aa923920476 req-75aac906-81a9-4936-89f4-7aaf7490e1b7 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:06.950483 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-4709f32a-2feb-44e5-8f51-9aa923920476 req-75aac906-81a9-4936-89f4-7aaf7490e1b7 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:06.978199 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-4709f32a-2feb-44e5-8f51-9aa923920476 req-75aac906-81a9-4936-89f4-7aaf7490e1b7 service nova] Creating event network-vif-plugged:4b3ce0cf-d1a9-466a-bd18-bd3a7d991ade for instance f778b712-e488-4610-bef1-c235f1266d9d on hv-cinder-81566 Jan 31 17:09:06.985969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-4709f32a-2feb-44e5-8f51-9aa923920476 req-75aac906-81a9-4936-89f4-7aaf7490e1b7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059895 Jan 31 17:09:06.986754 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 183/345] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:07.070437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:07.079445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-41c6302f-a804-49ea-8edc-a38bae21c6c0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.379191 Jan 31 17:09:07.093960 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 163/346] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:06 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:07.200094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:07.201372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] [instance: 0d32b0b6-8638-46ed-8ed0-43557be96554] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:07.213569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:07.219026 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:07.220435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:07.222399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:07.256490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] HTTP exception thrown: Instance 0d32b0b6-8638-46ed-8ed0-43557be96554 could not be found. Jan 31 17:09:07.259296 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] Returning 404 to user: Instance 0d32b0b6-8638-46ed-8ed0-43557be96554 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:09:07.262259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-95340302-bf40-4ec7-9f15-b7e989041aa7 tempest-VolumesNegativeTest-1371372257 tempest-VolumesNegativeTest-1371372257-project] 10.222.0.91 "GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554" status: 404 len: 111 microversion: 2.1 time: 0.067139 Jan 31 17:09:07.268937 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 184/347] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:07 2022] GET /compute/v2.1/servers/0d32b0b6-8638-46ed-8ed0-43557be96554 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:09:07.307356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:07.313187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:07.325017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:07.325584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:07.326622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:07.328971 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:07.768004 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:07.777232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-59d8a1f9-92ca-4eec-a674-865f7d561ef2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.477354 Jan 31 17:09:07.777901 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 164/348] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:07 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:08.097562 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:08.099887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:08.109140 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:08.110410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:08.111382 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:08.112076 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:08.283797 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-2ddaf52c-57ca-4c70-8f2e-1edf6d5e4ade req-a07a3319-7982-4649-8718-522683e34cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c409eb-9777-4683-b0bb-cc402bb60990", "tag": "3ea7d77d-76d2-44b3-8124-cb9910b6c5e1"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:08.285461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:08.285461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:09:08.300251 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-2ddaf52c-57ca-4c70-8f2e-1edf6d5e4ade req-a07a3319-7982-4649-8718-522683e34cf0 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:08.300936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-2ddaf52c-57ca-4c70-8f2e-1edf6d5e4ade req-a07a3319-7982-4649-8718-522683e34cf0 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:08.354026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-2ddaf52c-57ca-4c70-8f2e-1edf6d5e4ade req-a07a3319-7982-4649-8718-522683e34cf0 service nova] Creating event network-changed:3ea7d77d-76d2-44b3-8124-cb9910b6c5e1 for instance 48c409eb-9777-4683-b0bb-cc402bb60990 on hv-cinder-81566 Jan 31 17:09:08.359806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-2ddaf52c-57ca-4c70-8f2e-1edf6d5e4ade req-a07a3319-7982-4649-8718-522683e34cf0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084360 Jan 31 17:09:08.360610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 165/349] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:08.432988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:08.442938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5fb53346-f846-4327-853e-84ae0a69b178 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.348970 Jan 31 17:09:08.443527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 185/350] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:08 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:08.797349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:08.798025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:08.806129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:08.807216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:08.808494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:08.809184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.033422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:09.041831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bc813106-28ef-4e46-8540-e5aed6dfb9f6 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.251079 Jan 31 17:09:09.042426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 166/351] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:08 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:09.462352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:09.463205 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:09.471400 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:09.472001 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.473220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:09.473763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.569094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:09.570150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:09.577660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:09.578417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.579281 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:09.579749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.607150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lazy-loading 'flavor' on Instance uuid 1ee59a59-7ed3-4b35-8a54-a257556f657c {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:09:09.694336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:09.701519 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-394347e9-8344-4558-b50e-abc676023a78 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.243537 Jan 31 17:09:09.702097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 186/352] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:09 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:09.740741 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6b79c530-e4c6-4409-b13c-280a60701507 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action" status: 200 len: 32 microversion: 2.1 time: 0.175701 Jan 31 17:09:09.741581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 167/353] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:09:09 2022] POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:09:09.750707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:09.751318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:09.757515 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:09.757975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.758756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:09.759193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:09.902120 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:09.910217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2c590322-5f0d-4243-834e-89ab20755f58 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.163551 Jan 31 17:09:09.910798 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 187/354] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:09 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:10.059204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:10.060006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:10.066616 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:10.067102 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:10.067911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:10.068380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:10.214896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:10.222942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-25d26322-aecf-4fe5-bd41-60979cf3526d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.168211 Jan 31 17:09:10.223569 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 168/355] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:10 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:10.718489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:10.719085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:10.725642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:10.726092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:10.726871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:10.727308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:10.863302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:10.871306 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e864da31-0a6d-45bc-aa14-51c5341b4d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.156471 Jan 31 17:09:10.871869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 188/356] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:10 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:10.928795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:10.929401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:10.937544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:10.938012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:10.938801 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:10.939283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:11.080637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:11.088339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b4703fb1-f1ac-4ca6-8c49-13e36f9f1c1c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.163212 Jan 31 17:09:11.088915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 169/357] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:10 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:11.240066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:11.240697 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:11.247040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:11.247489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:11.248404 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:11.248848 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:11.388705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:11.397051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5560edbf-8bb1-4ae7-b2e6-df9ea9553b94 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.160772 Jan 31 17:09:11.397768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 189/358] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:11 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:11.889483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:11.890015 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:11.895898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:11.896384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:11.897169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:11.897610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:12.044455 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:12.052521 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-76d51025-2b4c-4eed-8620-ba2be9bf3059 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.165955 Jan 31 17:09:12.053086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 170/359] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:11 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:12.105670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:12.106569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:12.112984 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:12.113438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:12.114213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:12.114647 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:12.253308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:12.260791 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-026365fa-fc73-4cd2-9fcb-5d651b32516c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.159701 Jan 31 17:09:12.261370 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 190/360] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:12 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:12.414686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:12.415292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:12.424295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:12.425121 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:12.426529 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:12.427334 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:12.581925 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:12.590943 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f4531006-5220-4345-96ec-7de51d8cbb5f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.179859 Jan 31 17:09:12.591524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 171/361] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:12 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:13.069948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:13.070556 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:13.077223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:13.077672 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:13.078440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:13.078877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:13.218127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:13.225621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1c3c3a7b-a7c6-4e87-aa51-513a2c0c9dbb tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1313 microversion: 2.1 time: 0.159407 Jan 31 17:09:13.226183 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 191/362] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:13 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:13.278014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:13.278691 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:13.285330 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:13.285853 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:13.286698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:13.287176 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:13.456596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:13.464045 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-88fc1174-510c-47f1-b900-8d6dc0655f14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.190184 Jan 31 17:09:13.464647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 172/363] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:13 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:13.608626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:13.609611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:13.616982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:13.617441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:13.618340 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:13.619259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:13.762624 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:13.770179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-33f32229-6311-46a8-a2f7-2b6efc7e7bef tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.165677 Jan 31 17:09:13.771255 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 192/364] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:13 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:14.242597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:14.243139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:14.249086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:14.249538 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:14.250605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:14.251047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:14.386056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:14.393389 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e1f3f466-52c7-4860-b044-b3ad99579174 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1495 microversion: 2.1 time: 0.154547 Jan 31 17:09:14.393961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 173/365] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:14 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:14.480699 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:14.481314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:14.487547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:14.488004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:14.488821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:14.489266 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:14.624300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:14.631801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1fa9adb9-0149-48e9-a5df-f3abaee672c5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.154846 Jan 31 17:09:14.632437 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 193/366] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:14 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:14.787747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:14.788382 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:14.796408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:14.796903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:14.797863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:14.798299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:14.969783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:14.977018 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-61af7ebe-de0f-4edc-ae8f-6d6eb6ed8720 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.192849 Jan 31 17:09:14.977578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 174/367] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:14 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:15.650795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:15.652539 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:15.664971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:15.664971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:15.664971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:15.664971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:15.805916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:15.814450 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d69b9934-0d5b-42fb-932b-c65116425415 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.168957 Jan 31 17:09:15.815004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 194/368] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:15 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:15.825596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:15.826106 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:15.832582 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:15.833113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:15.833933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:15.834344 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:15.860958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:09:15.948501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d6211d29-2712-48cc-b4ab-f68b3d8f28c7 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 204 len: 0 microversion: 2.1 time: 0.126668 Jan 31 17:09:15.949088 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 175/369] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:09:15 2022] DELETE /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:09:15.957146 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:15.957787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:15.964342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:15.964797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:15.965771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:15.966215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:15.995138 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:15.996264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:16.002581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:16.003261 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:16.004431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:16.004972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:16.236526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:16.250817 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-369de369-e0bb-41db-a29c-f699648bf7c4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1501 microversion: 2.1 time: 0.296652 Jan 31 17:09:16.252128 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 195/370] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:15 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:16.288874 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:16.297448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-03c3d15e-f189-4322-89fe-a69c0b183899 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.306415 Jan 31 17:09:16.307218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 176/371] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:15 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:16.830522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:16.831165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:16.837957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:16.838430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:16.839255 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:16.839734 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:17.035379 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:17.043991 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e52842fe-e7fa-4c4b-960b-f74de042969a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.216939 Jan 31 17:09:17.044674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 196/372] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:16 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:17.269503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:17.270118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:17.279478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:17.279952 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:17.280783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:17.281218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:17.315501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:17.316468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:17.326921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:17.327470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:17.330527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:17.331201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:17.580918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:17.590084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-326e7e6c-bc6e-49fe-92ba-0fd2fd4bb1e0 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1501 microversion: 2.1 time: 0.324111 Jan 31 17:09:17.590664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:17.591065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 177/373] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:17 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1501 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:17.609681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-868d20f5-a8db-4c97-b19a-bbf84c1b2476 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.298018 Jan 31 17:09:17.620940 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 197/374] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:17 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:18.062545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:18.063252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:18.069438 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:18.070018 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:18.071016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:18.071466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:18.214630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:18.221982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c045c7c1-f4be-4cba-b409-49e39467a46d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.164520 Jan 31 17:09:18.222551 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 178/375] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:18 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:18.610512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:18.611807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:18.635354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:18.636032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:18.645900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:18.647477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:18.648081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:18.649151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:18.650290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:18.650948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:18.651920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:18.655099 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:18.886439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:18.893701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:18.893970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-18b6a9d2-f69a-4e8a-a83e-a93038113609 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.268276 Jan 31 17:09:18.894368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 179/376] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:18 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:18.904732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e530bc41-bfa1-4d94-a50c-e53aee2981dd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1501 microversion: 2.1 time: 0.297567 Jan 31 17:09:18.904732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 198/377] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:18 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:19.240039 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:19.240947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:19.249860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:19.250902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:19.252165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:19.252677 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:19.391769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:19.399156 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4317e8cf-bcb8-4fa3-8332-e3da2c1fe08b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.162920 Jan 31 17:09:19.400388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 180/378] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:19 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:19.917614 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:19.919198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:19.919937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:19.921539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:19.928364 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:19.928645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:19.929242 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:19.929599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:19.930274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:19.930968 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:19.932058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:19.933245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:20.095208 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:20.102807 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ce8d90c7-0a43-4715-907a-21f873da1284 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1459 microversion: 2.1 time: 0.187870 Jan 31 17:09:20.103742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 181/379] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:19 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1459 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:20.133137 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-4bbc9fb0-5b85-4e29-858c-d541f464c710 req-1d236c38-2814-44ef-a070-3d459d6bf749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778b712-e488-4610-bef1-c235f1266d9d", "name": "network-vif-deleted", "tag": "4b3ce0cf-d1a9-466a-bd18-bd3a7d991ade"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:20.135676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:20.135676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:09:20.142933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-4bbc9fb0-5b85-4e29-858c-d541f464c710 req-1d236c38-2814-44ef-a070-3d459d6bf749 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:20.143242 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-4bbc9fb0-5b85-4e29-858c-d541f464c710 req-1d236c38-2814-44ef-a070-3d459d6bf749 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:20.154408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-4bbc9fb0-5b85-4e29-858c-d541f464c710 req-1d236c38-2814-44ef-a070-3d459d6bf749 service nova] Creating event network-vif-deleted:4b3ce0cf-d1a9-466a-bd18-bd3a7d991ade for instance f778b712-e488-4610-bef1-c235f1266d9d on hv-cinder-81566 Jan 31 17:09:20.159296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-4bbc9fb0-5b85-4e29-858c-d541f464c710 req-1d236c38-2814-44ef-a070-3d459d6bf749 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029741 Jan 31 17:09:20.159958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 182/380] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:20.201950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:20.209186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-876dcf0e-937f-4a79-a7a5-5f34fdd3b18f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.301656 Jan 31 17:09:20.209752 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 199/381] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:19 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:20.418595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:20.419195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:20.425355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:20.425803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:20.426583 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:20.427051 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:20.570142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:20.579920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6684277b-b086-4c70-b76e-ba3976261569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.166042 Jan 31 17:09:20.580823 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 183/382] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:20 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:21.121607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:21.122218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:21.128771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.129222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.130035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.130467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.162245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.162694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.163143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lazy-loading 'fault' on Instance uuid f778b712-e488-4610-bef1-c235f1266d9d {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:09:21.203422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:21.210776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2830ee68-2631-4666-a0b0-d4e8827c3606 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 200 len: 1303 microversion: 2.1 time: 0.093792 Jan 31 17:09:21.211335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 200/383] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:21 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:21.228243 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:21.228864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:21.234815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.235324 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.236172 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.236670 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.372737 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:21.380284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2470373b-1412-4fed-8b3d-04ecd4ae6415 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.156371 Jan 31 17:09:21.381095 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 184/384] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:21 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:21.600585 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:21.601193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:21.607816 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.608304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.609083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:21.609547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:21.989157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:21.997218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a470a31f-5f4f-4d5d-9059-76476191ce1d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.401734 Jan 31 17:09:21.997783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 201/385] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:21 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:22.232470 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:22.233075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f778b712-e488-4610-bef1-c235f1266d9d] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:22.239389 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.239848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.240657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.241130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.255403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] HTTP exception thrown: Instance f778b712-e488-4610-bef1-c235f1266d9d could not be found. Jan 31 17:09:22.255992 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Returning 404 to user: Instance f778b712-e488-4610-bef1-c235f1266d9d could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:09:22.256844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-57eb193d-e95c-4cac-8331-5d3505149f6e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d" status: 404 len: 111 microversion: 2.1 time: 0.028930 Jan 31 17:09:22.257388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 185/386] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:22 2022] GET /compute/v2.1/servers/f778b712-e488-4610-bef1-c235f1266d9d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:09:22.355929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1425990613", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "5d1f695b-2d4d-4037-80ef-3ba6895b5237"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:22.396726 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:22.397260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:22.404300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.404742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.405525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.405961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.406513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] validate_networks() for [('5d1f695b-2d4d-4037-80ef-3ba6895b5237', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:09:22.652956 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:22.661021 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-53c8a76f-a72c-4919-bf72-36930626881d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.267959 Jan 31 17:09:22.662030 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 186/387] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:22 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:22.734668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-4eee1db8-3139-4dc1-b07f-9bb31202ce42 req-0536eb1f-e25e-4dfe-836e-c9e05fa96cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c409eb-9777-4683-b0bb-cc402bb60990", "name": "network-vif-plugged", "status": "completed", "tag": "3ea7d77d-76d2-44b3-8124-cb9910b6c5e1"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:22.736496 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:22.736496 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:09:22.744141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-4eee1db8-3139-4dc1-b07f-9bb31202ce42 req-0536eb1f-e25e-4dfe-836e-c9e05fa96cfa service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.744659 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-4eee1db8-3139-4dc1-b07f-9bb31202ce42 req-0536eb1f-e25e-4dfe-836e-c9e05fa96cfa service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.756299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-4eee1db8-3139-4dc1-b07f-9bb31202ce42 req-0536eb1f-e25e-4dfe-836e-c9e05fa96cfa service nova] Creating event network-vif-plugged:3ea7d77d-76d2-44b3-8124-cb9910b6c5e1 for instance 48c409eb-9777-4683-b0bb-cc402bb60990 on hv-cinder-81566 Jan 31 17:09:22.762558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-4eee1db8-3139-4dc1-b07f-9bb31202ce42 req-0536eb1f-e25e-4dfe-836e-c9e05fa96cfa service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030990 Jan 31 17:09:22.763952 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 187/388] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:22.817978 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:09:22.818409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:09:22.818882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:09:22.819292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:09:22.819706 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:09:22.828884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.829337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.830147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:22.830587 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:22.847090 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Getting quotas for project d9ff165bd619436cb3de649388117b10. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:09:22.851035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Getting quotas for user 7c238df167884c2fa93569d4b231afcf and project d9ff165bd619436cb3de649388117b10. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:09:22.861605 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:09:22.863894 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:09:22.913138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ad58ef66-11c4-42de-9bb0-277fa9890d27 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561227 Jan 31 17:09:22.913677 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 202/389] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:09:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:09:22.924119 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ec2a6e25-0b47-4fb4-a2dd-2926e1d117ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:22.924818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ec2a6e25-0b47-4fb4-a2dd-2926e1d117ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:22.993884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ec2a6e25-0b47-4fb4-a2dd-2926e1d117ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:23.001793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ec2a6e25-0b47-4fb4-a2dd-2926e1d117ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1214 microversion: 2.1 time: 0.081645 Jan 31 17:09:23.002963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 188/390] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:22 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:23.018219 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:23.019115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:23.027041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:23.027532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:23.028474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:23.028938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:23.224088 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:23.233383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-52ffd52a-87d0-4ec8-a39c-96470d153f65 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.219795 Jan 31 17:09:23.234276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 203/391] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:23 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:23.677170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:23.678456 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:23.685801 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:23.686284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:23.687089 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:23.687538 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:23.839947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:23.847445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-593f1b2d-7924-4859-a987-f1b984080889 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.173959 Jan 31 17:09:23.848024 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 189/392] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:23 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:24.021910 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:24.022817 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:24.030080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:24.030563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:24.031408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:24.031880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:24.097500 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:24.104876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-de41cf58-e6f3-4964-814d-41cb25fd19b2 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1218 microversion: 2.1 time: 0.087477 Jan 31 17:09:24.105681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 204/393] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:24 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:24.251069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:24.251702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:24.259395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:24.259954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:24.260781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:24.261266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:24.430527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:24.438321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-19b982d0-c4c0-4c4c-8fa1-2af20160d3de tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.191158 Jan 31 17:09:24.438965 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 190/394] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:24 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:24.864744 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:24.865498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:24.872372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:24.872922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:24.873898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:24.874368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:25.018885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:25.026659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4bca53d9-3daa-48f2-84ef-9d6d3ca46699 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.166101 Jan 31 17:09:25.027260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 205/395] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:24 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:25.121773 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:25.122564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:25.129417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:25.129870 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:25.130657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:25.131092 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:25.200700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:25.208313 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-61b7829f-bb08-4f0a-8d25-916f19b8364e tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1266 microversion: 2.1 time: 0.090282 Jan 31 17:09:25.219288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 191/396] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:25 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:25.457042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:25.458324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:25.466304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:25.466895 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:25.467914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:25.468640 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:25.691994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:25.707189 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cfcc2338-aeec-4a8d-9413-427c606c4904 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.254776 Jan 31 17:09:25.707787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 206/397] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:25 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:26.043558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:26.044202 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:26.050300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:26.050750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:26.051904 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:26.052556 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:26.226837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:26.227553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:26.234221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:26.234910 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:26.235960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:26.236491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:26.322781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:26.332014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f4067659-422a-4acf-8763-f414f6034387 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1318 microversion: 2.1 time: 0.293009 Jan 31 17:09:26.332880 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 192/398] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:26 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:26.482308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:26.489806 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ff1aa34d-65ca-49e8-8ce7-41e4e7b6e9fd tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.266785 Jan 31 17:09:26.490592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 207/399] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:26 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:26.724983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:26.725750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:26.732935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:26.733304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:26.734280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:26.734722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:26.988778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:26.996228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9de232bb-a3e7-4bee-96f6-08a1b3178109 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.275363 Jan 31 17:09:26.997000 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 193/400] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:26 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:27.075893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-19fae17c-7c6b-4cde-9d41-781c8335ebf6 req-11236d07-b1a8-497e-9be7-151ef478b33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b08c77-2b9e-4c14-beed-8feae52e5b84", "tag": "4980a218-27b4-4dd6-a6b2-247e621f480d"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:27.077552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:27.077552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:09:27.084452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-19fae17c-7c6b-4cde-9d41-781c8335ebf6 req-11236d07-b1a8-497e-9be7-151ef478b33d service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:27.084906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-19fae17c-7c6b-4cde-9d41-781c8335ebf6 req-11236d07-b1a8-497e-9be7-151ef478b33d service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:27.099077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-19fae17c-7c6b-4cde-9d41-781c8335ebf6 req-11236d07-b1a8-497e-9be7-151ef478b33d service nova] Creating event network-changed:4980a218-27b4-4dd6-a6b2-247e621f480d for instance f4b08c77-2b9e-4c14-beed-8feae52e5b84 on hv-cinder-81566 Jan 31 17:09:27.105597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-19fae17c-7c6b-4cde-9d41-781c8335ebf6 req-11236d07-b1a8-497e-9be7-151ef478b33d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033790 Jan 31 17:09:27.106277 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 208/401] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:27.353874 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:27.354523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:27.361079 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:27.361536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:27.362326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:27.362775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:27.510074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:27.510934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:27.517586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:27.518123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:27.518993 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:27.519536 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:27.621134 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:27.631146 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-55f1752d-6014-4a4f-9f60-dc675cb67641 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1507 microversion: 2.1 time: 0.280931 Jan 31 17:09:27.632436 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 194/402] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:27 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:27.776921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:27.784284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-efb90e0b-f8ef-426f-bb35-def78d69a432 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.279317 Jan 31 17:09:27.784870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 209/403] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:27 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:28.013598 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:28.014205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:28.020013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:28.020502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:28.021285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:28.021730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:28.248158 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:28.256171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b4eba795-f8d4-46fe-916a-a0c894d839ed tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.246279 Jan 31 17:09:28.256763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 195/404] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:28 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:28.802348 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:28.802906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:28.809519 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:28.809977 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:28.810812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:28.812613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:28.971391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:28.982063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1ecd8135-0b20-4245-9e72-0f1ecd422345 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.183901 Jan 31 17:09:28.983532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 210/405] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:28 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:29.273208 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:29.273815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:29.281207 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:29.281669 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:29.282460 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:29.282891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:29.436660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:29.444056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-08c6f0bf-0f75-4db8-ad86-206a5fe1cf87 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.174508 Jan 31 17:09:29.444648 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 196/406] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:29 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:30.005530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:30.006588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:30.017898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:30.018591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:30.019454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:30.019906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:30.062755 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c0ca850-4f42-4226-ba45-fe505b63665d"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:30.063846 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:30.074527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:30.078593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:30.080058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:30.080555 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:30.210800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:30.222049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b7eb5279-a6b2-4345-a87d-8527c5dd9567 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.224951 Jan 31 17:09:30.223039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 211/407] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:29 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:30.449064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f5c2645e-d314-401b-a1f3-a023a02d9d6f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390500 Jan 31 17:09:30.449712 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 197/408] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:09:30 2022] POST /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:30.471249 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:30.485532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:30.503785 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:30.504633 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:30.506325 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:30.507301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:30.710403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:30.719107 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5bb533a2-0e57-48a7-b679-d3a856e3bdac tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.254308 Jan 31 17:09:30.719693 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 212/409] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:30 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:31.242660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:31.244044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:31.250588 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:31.251048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:31.251831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:31.252305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:31.424577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:31.433755 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-221dfc09-ad4e-4f6f-8999-a9161a484066 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.195761 Jan 31 17:09:31.434418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 198/410] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:31 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:31.735883 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:31.736653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:31.743213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:31.743645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:31.744581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:31.745119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:31.888043 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:31.895527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6783fa08-daed-4415-94b0-896a2d70ed5b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.163361 Jan 31 17:09:31.896123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 213/411] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:31 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:32.450756 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:32.451265 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:32.457487 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:32.457935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:32.458704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:32.459139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:32.592230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:32.605411 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-99f08ae7-4ec8-4237-af49-edb00775c1ae tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.158146 Jan 31 17:09:32.606338 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 199/412] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:32 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:32.913505 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:32.914165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:32.920801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:32.921285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:32.922117 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:32.922568 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:33.051881 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:33.059945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-14ed133e-636d-4745-8d1d-17d7a4b29569 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.150225 Jan 31 17:09:33.060551 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 214/413] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:32 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:33.623484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:33.623998 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:33.630446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:33.630896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:33.631672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:33.632125 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:33.771040 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:33.778886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6ef89eb1-3eac-476d-be25-8dd0713aa334 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.159141 Jan 31 17:09:33.779450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 200/414] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:33 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:34.077734 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:34.078373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:34.084567 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:34.085018 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:34.085790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:34.086227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:34.221589 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:34.229685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3b0e5aa2-64e5-401a-ba8a-b13720a2012f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.155857 Jan 31 17:09:34.230235 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 215/415] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:34 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:34.795705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:34.796479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:34.802890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:34.803346 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:34.804174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:34.804620 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:34.954341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:34.962793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-401d585a-bcb7-4e1c-8321-02ce1d64d93d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.170385 Jan 31 17:09:34.963379 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 201/416] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:34 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:35.246134 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:35.246757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:35.253383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:35.253839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:35.254638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:35.255085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:35.390981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:35.398898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e1caee09-65fe-45ce-a590-c28d31d60d8b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.156474 Jan 31 17:09:35.400004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 216/417] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:35 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:35.979911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:35.980640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:35.987296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:35.987738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:35.988575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:35.989009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:36.130046 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:36.137896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7101ded1-ab9f-4dce-a036-efea981c40b4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.162914 Jan 31 17:09:36.138458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 202/418] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:35 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:36.416309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:36.416957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:36.423534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:36.424029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:36.424924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:36.425343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:36.564346 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:36.572579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7810d71f-b47c-4b2a-a49a-4c3a53f80ee7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.160023 Jan 31 17:09:36.573272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 217/419] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:36 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:37.159058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:37.159872 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:37.166482 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:37.166936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:37.167730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:37.168206 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:37.310772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:37.318354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-17f707be-b807-45b7-8a79-8fa9087aa7d9 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.166065 Jan 31 17:09:37.318935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 203/420] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:37 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:37.590256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:37.590912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:37.597224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:37.597741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:37.598534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:37.598994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:37.756839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:37.765503 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-de68b2d3-c45d-45f7-b161-48d4fb9e8b44 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.178962 Jan 31 17:09:37.766088 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 218/421] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:37 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:38.337425 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:38.338118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:38.344619 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:38.345073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:38.345891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:38.346363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:38.490889 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:38.500212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f8e5558a-2f59-4590-b2cb-eed4a98f876d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.166765 Jan 31 17:09:38.500878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 204/422] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:38 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:38.782090 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:38.782696 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:38.789100 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:38.789552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:38.790468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:38.790905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:38.932592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:38.946749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-431c7b4e-3731-48d5-95ce-2d70c5b3aca4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.166735 Jan 31 17:09:38.947292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 219/423] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:38 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:39.521008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:39.523345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:39.534401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:39.534916 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:39.535819 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:39.536465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:39.952660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:39.962543 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-591059f0-47e4-4406-badb-6e66c470b677 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.448411 Jan 31 17:09:39.963169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 205/424] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:39 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:39.967224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:39.967998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:39.975268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:39.975783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:39.976683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:39.977458 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:40.150872 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:40.159058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-382d664b-6182-4f56-a5a8-8789c7bcff42 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.198382 Jan 31 17:09:40.159643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 220/425] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:39 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:40.630447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-20ebaa7b-2b0a-40fc-8aca-3be92012a3d5 req-b747f9b2-e830-4dc3-88bc-dbfd07ee2fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b08c77-2b9e-4c14-beed-8feae52e5b84", "name": "network-vif-plugged", "status": "completed", "tag": "4980a218-27b4-4dd6-a6b2-247e621f480d"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:40.634632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:40.634632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:09:40.645608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-20ebaa7b-2b0a-40fc-8aca-3be92012a3d5 req-b747f9b2-e830-4dc3-88bc-dbfd07ee2fb7 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:40.646118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-20ebaa7b-2b0a-40fc-8aca-3be92012a3d5 req-b747f9b2-e830-4dc3-88bc-dbfd07ee2fb7 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:40.658673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-20ebaa7b-2b0a-40fc-8aca-3be92012a3d5 req-b747f9b2-e830-4dc3-88bc-dbfd07ee2fb7 service nova] Creating event network-vif-plugged:4980a218-27b4-4dd6-a6b2-247e621f480d for instance f4b08c77-2b9e-4c14-beed-8feae52e5b84 on hv-cinder-81566 Jan 31 17:09:40.664285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-20ebaa7b-2b0a-40fc-8aca-3be92012a3d5 req-b747f9b2-e830-4dc3-88bc-dbfd07ee2fb7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041201 Jan 31 17:09:40.665195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 206/426] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:40.988804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:40.989467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:40.996568 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:40.997051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:40.997858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:40.998296 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.179209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:41.182616 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:41.190069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.191014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.192236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.192805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.213691 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:41.222053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-880e7ca8-9308-4d83-812c-743b3d91a6f4 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.236848 Jan 31 17:09:41.222912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 221/427] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:40 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:41.230373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c0ca850-4f42-4226-ba45-fe505b63665d"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:41.231643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:41.238142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.238796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.239389 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.239827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.334765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] HTTP exception thrown: Invalid volume: volume 0c0ca850-4f42-4226-ba45-fe505b63665d is already attached to instances: 48c409eb-9777-4683-b0bb-cc402bb60990 Jan 31 17:09:41.335370 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Returning 400 to user: Invalid volume: volume 0c0ca850-4f42-4226-ba45-fe505b63665d is already attached to instances: 48c409eb-9777-4683-b0bb-cc402bb60990 {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:09:41.336254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8b2cf2a7-7d69-466d-a22a-d8838202e622 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109821 Jan 31 17:09:41.340166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 222/428] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:09:41 2022] POST /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:09:41.354687 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:41.366610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-63bf66e1-ebd8-4c7d-a715-203bc4df9e51 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.190942 Jan 31 17:09:41.368084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 207/429] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:41 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:41.420007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:41.420869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:41.432365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.433182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.434181 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.434631 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.532703 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'services' on Instance uuid 48c409eb-9777-4683-b0bb-cc402bb60990 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:09:41.631610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0e62f05f-9aa4-45fc-a2ed-cf903682b44c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments/0c0ca850-4f42-4226-ba45-fe505b63665d" status: 202 len: 0 microversion: 2.1 time: 0.217663 Jan 31 17:09:41.632803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 223/430] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:09:41 2022] DELETE /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments/0c0ca850-4f42-4226-ba45-fe505b63665d => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:09:41.642658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:41.643644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:41.650553 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.651133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.652147 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:41.652665 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:41.702950 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ba57630a-cd18-4e3c-8a5e-f94e3f91dfaa tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063844 Jan 31 17:09:41.703891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 208/431] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:09:41 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:42.244934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:42.246242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:42.256433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:42.257373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:42.262749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:42.262749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:42.407515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:42.420560 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:42.438101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:42.438965 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:42.440844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:42.442446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:42.491272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:42.504322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3ab8b315-9a0f-46de-88f8-25c0b899fb1d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.267211 Jan 31 17:09:42.506308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 224/432] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:42 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:42.715617 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:42.723192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:42.726975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:42.727537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:42.728505 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:42.729038 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:42.767777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-feec42b8-885c-443c-a994-22ce239130e4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056719 Jan 31 17:09:42.768913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 225/433] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:09:42 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:09:42.799182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:42.813133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6ae700a9-52dd-4781-b2ea-cc1c7445759d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.429604 Jan 31 17:09:42.814216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 209/434] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:42 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:43.531101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:43.531871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:43.539598 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:43.540053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:43.541150 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:43.541652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:43.779819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:43.784961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:43.786401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:43.790411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3c256553-9f74-4703-8710-32b73d4a1aec tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.263015 Jan 31 17:09:43.797445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:43.798226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:43.799575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:43.800943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 226/435] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:43 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:43.801315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:43.835147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:43.836617 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:43.846521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:43.847249 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:43.848847 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:43.849816 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:43.859684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-472c16d6-ebe1-4d46-ae1d-bcb3463d23a9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081467 Jan 31 17:09:43.861375 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 210/436] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:09:43 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:09:44.074268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:44.087089 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c4f50c5c-6ce8-4e8a-8fa4-f1edebf3b360 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.257981 Jan 31 17:09:44.088213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 227/437] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:43 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:44.809188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:44.810136 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:44.821139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:44.821991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:44.823450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:44.824318 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:44.879095 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:44.881114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:44.894527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:44.895627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:44.897336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:44.898187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:44.961660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fc7cc338-77e6-4881-be91-a8fadd7fd5c8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089509 Jan 31 17:09:44.962309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 228/438] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:09:44 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 17:09:45.111574 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:45.112348 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:45.129778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:45.131490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:45.136522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:45.138615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:45.291785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:45.299758 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-75f0e7a7-07ad-44e7-aaa2-48de6fc303f5 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1314 microversion: 2.1 time: 0.494514 Jan 31 17:09:45.310098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 211/439] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:44 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:45.325302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1492574213", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "16fc1cee-4030-4155-ac8c-c75537e343ae"}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:45.423877 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] validate_networks() for [('16fc1cee-4030-4155-ac8c-c75537e343ae', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:09:45.642634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:45.656016 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-36158f0b-2401-462b-8478-ef87f321a931 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.547887 Jan 31 17:09:45.672626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 229/440] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:45 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:46.315793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:09:46.317360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:09:46.318416 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:09:46.319385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:09:46.321304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:09:46.328451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:46.329419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:46.340964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:46.342113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:46.343431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:46.343763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:46.344566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:46.344900 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:46.345890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:46.346545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:46.376149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:09:46.394918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Getting quotas for user d7d72db9dcc44391af4b1703b0e4377a and project aa89d77163de421b8159c0095f47b6d2. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:09:46.413699 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:09:46.417292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:09:46.484610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5df53dd1-395d-4510-b65e-8f93b890d31c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172530 Jan 31 17:09:46.485501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 212/441] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:09:46.503637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-794d121f-0363-40e2-9890-b7de923d55a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:46.514593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-794d121f-0363-40e2-9890-b7de923d55a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:46.709114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-794d121f-0363-40e2-9890-b7de923d55a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:46.726065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-794d121f-0363-40e2-9890-b7de923d55a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1218 microversion: 2.1 time: 0.230241 Jan 31 17:09:46.728042 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 213/442] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:46 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:46.739150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:46.740316 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:46.747155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:46.748006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:46.749351 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:46.750140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:46.812595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:46.833329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3cf0508f-2209-424c-b1a1-56d66818a437 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1497 microversion: 2.1 time: 0.510370 Jan 31 17:09:46.835755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 230/443] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:46 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1497 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:47.159670 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:47.175423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-09abf3d6-7fa2-472c-9e24-38b8f44bb3b4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1501 microversion: 2.1 time: 0.445071 Jan 31 17:09:47.176240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 214/444] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:46 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1501 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:47.202690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccbd231f-edc7-4683-a684-451793f7b619"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:47.205317 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:47.218046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.219243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.221096 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.222165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.282651 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] HTTP exception thrown: Cannot 'attach_volume' instance 1ee59a59-7ed3-4b35-8a54-a257556f657c while it is in vm_state rescued Jan 31 17:09:47.284019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Returning 409 to user: Cannot 'attach_volume' instance 1ee59a59-7ed3-4b35-8a54-a257556f657c while it is in vm_state rescued {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:09:47.285175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f6afebea-f1a7-43bb-a894-0bc0ed85c978 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090328 Jan 31 17:09:47.286792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 231/445] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:09:47 2022] POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 31 17:09:47.302630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:47.304013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:47.334014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.335296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.337363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.338305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.534569 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-80a51459-98be-492c-a2e4-23d791f0a4e6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action" status: 202 len: 0 microversion: 2.1 time: 0.239996 Jan 31 17:09:47.535522 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 215/446] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:09:47 2022] POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:09:47.556224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:47.556224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:47.556224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.557378 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.558408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.558960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.753129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:47.753853 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:47.783633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.793191 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:47.795115 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:47.796540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:48.151642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:48.170040 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6f173c32-c402-4e60-a2aa-c455da204e25 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1270 microversion: 2.1 time: 0.420841 Jan 31 17:09:48.177339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 216/447] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:47 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1270 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:48.263700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:48.265111 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:48.277096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:48.277938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:48.279430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:48.280302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:48.338364 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:09:48.446257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:48.454272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e46044bc-3099-443f-9b74-f2bcbb416558 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1509 microversion: 2.1 time: 0.913726 Jan 31 17:09:48.454856 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 232/448] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:47 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1509 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:48.474781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b6224c0a-88a5-4e33-af17-3c5b56763010 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "DELETE /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 204 len: 0 microversion: 2.1 time: 0.217840 Jan 31 17:09:48.482448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 217/449] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:09:48 2022] DELETE /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 17:09:48.488772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:48.489485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:48.496564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:48.497023 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:48.498111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:48.498763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:48.848545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:48.857039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-789c992c-e1f8-45ec-9f65-204e926de14c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1503 microversion: 2.1 time: 0.372703 Jan 31 17:09:48.858102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 233/450] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:48 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:49.208043 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:49.209347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:49.221473 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:49.222688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:49.224443 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:49.225178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:49.378144 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:49.394223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-70816b6f-c4b7-44c4-8986-124b23b5ab27 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1288 microversion: 2.1 time: 0.193805 Jan 31 17:09:49.396315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 218/451] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:49 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1288 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:49.496045 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:49.497913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:49.514623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:49.515947 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:49.517816 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:49.518822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:49.891226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:49.893077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:49.912960 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:49.913664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:49.915961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:49.917385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:49.983274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:49.994874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8f0bb441-b18d-46d8-9c29-a4802c92aef2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1509 microversion: 2.1 time: 0.510473 Jan 31 17:09:49.995804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 234/452] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:49 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1509 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:50.301958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:50.330442 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bedf7bfa-deb1-42f3-b971-477cfd649195 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1503 microversion: 2.1 time: 0.447386 Jan 31 17:09:50.342492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 219/453] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:49 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:50.420808 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:50.421416 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:50.438267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:50.439044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:50.440509 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:50.441292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:50.569629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:50.595388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a4cee7d8-7bbc-417f-9488-d5cfbf6d6cc2 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1276 microversion: 2.1 time: 0.178710 Jan 31 17:09:50.603978 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 235/454] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:50 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:51.030923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:51.033244 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:51.046224 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:51.047686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:51.049773 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:51.051098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:51.364826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:51.366976 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:51.399997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:51.401210 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:51.403263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:51.404523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:51.801591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:51.826347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-91bd7d4a-8215-4b9f-aedd-63d88ef2839d tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1503 microversion: 2.1 time: 0.466324 Jan 31 17:09:51.828590 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 236/455] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:51 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:51.850071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:51.850332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:51.864443 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:51.871386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:51.874025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:51.875242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:51.875820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:51.877447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b736fa68-86a3-461b-9676-b6f90865376b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1509 microversion: 2.1 time: 0.867038 Jan 31 17:09:51.881573 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 220/456] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:51 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1509 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:52.335210 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:52.345048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c0afe871-a723-4562-95c1-c0360aee272f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.511796 Jan 31 17:09:52.346329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 237/457] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:51 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:52.583789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-41f893db-f418-46c6-914f-5ab60845beee req-b8761cf1-a3d3-47f7-9a0f-b59854ae89ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9693f6d0-87a8-4064-8c0c-de845eb1ea58", "tag": "559ede79-4a4a-4a5d-8f03-35f44dd495b1"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:52.591264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:52.591264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:09:52.614095 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-41f893db-f418-46c6-914f-5ab60845beee req-b8761cf1-a3d3-47f7-9a0f-b59854ae89ef service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:52.616653 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-41f893db-f418-46c6-914f-5ab60845beee req-b8761cf1-a3d3-47f7-9a0f-b59854ae89ef service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:52.651205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-41f893db-f418-46c6-914f-5ab60845beee req-b8761cf1-a3d3-47f7-9a0f-b59854ae89ef service nova] Creating event network-changed:559ede79-4a4a-4a5d-8f03-35f44dd495b1 for instance 9693f6d0-87a8-4064-8c0c-de845eb1ea58 on hv-cinder-81566 Jan 31 17:09:52.660020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-41f893db-f418-46c6-914f-5ab60845beee req-b8761cf1-a3d3-47f7-9a0f-b59854ae89ef service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080141 Jan 31 17:09:52.661378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 221/458] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:09:52.860202 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:52.870252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:52.891242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:52.895522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:52.897527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:52.898275 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:52.909493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:52.911216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:52.934181 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:52.934512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:52.938036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:52.938669 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:53.349714 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:53.362428 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fe1be5ea-5e96-4a61-893b-3178158fe916 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1503 microversion: 2.1 time: 0.508650 Jan 31 17:09:53.363828 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 238/459] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:52 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:53.370293 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:53.374231 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:53.375192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:53.380141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ab3da4b7-d999-40e5-831c-b87805931f01 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1509 microversion: 2.1 time: 0.481738 Jan 31 17:09:53.390522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:53.390705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 222/460] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:52 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1509 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:53.392044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:53.392215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:53.393367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:53.633496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:53.646865 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-222a627b-5bf6-4405-8c87-22bb184fd405 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.277650 Jan 31 17:09:53.647862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 239/461] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:53 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:54.386534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:54.389861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:54.399186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:54.399970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:54.415894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:54.416915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:54.418010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:54.418813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:54.419471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:54.420051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:54.421224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:54.421921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:55.300751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:55.304450 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:55.325385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-88d334a9-80e6-4c6f-a869-a80e46df9386 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1503 microversion: 2.1 time: 0.945572 Jan 31 17:09:55.337337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bbf0c29c-7b14-4b42-b6c1-3976360d1261 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1509 microversion: 2.1 time: 0.941674 Jan 31 17:09:55.338726 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 240/462] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:54 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1509 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:55.340820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 223/463] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:54 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1503 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:55.353486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:55.355012 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:55.365697 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:55.367062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:55.369195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:55.370557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:55.727267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:55.738992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-93c6bfa3-4efc-42a9-adf7-61d3b7a9c108 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.398326 Jan 31 17:09:55.752454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 241/464] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:55 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:56.058864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-794945ea-4d84-4db1-896f-0620fb919c3f req-9aec8625-9b86-48bb-bc42-51b7b5692017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b08c77-2b9e-4c14-beed-8feae52e5b84", "name": "network-vif-deleted", "tag": "4980a218-27b4-4dd6-a6b2-247e621f480d"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:09:56.061941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:09:56.061941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:09:56.074401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-794945ea-4d84-4db1-896f-0620fb919c3f req-9aec8625-9b86-48bb-bc42-51b7b5692017 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.075535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-794945ea-4d84-4db1-896f-0620fb919c3f req-9aec8625-9b86-48bb-bc42-51b7b5692017 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.096296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-794945ea-4d84-4db1-896f-0620fb919c3f req-9aec8625-9b86-48bb-bc42-51b7b5692017 service nova] Creating event network-vif-deleted:4980a218-27b4-4dd6-a6b2-247e621f480d for instance f4b08c77-2b9e-4c14-beed-8feae52e5b84 on hv-cinder-81566 Jan 31 17:09:56.106304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-794945ea-4d84-4db1-896f-0620fb919c3f req-9aec8625-9b86-48bb-bc42-51b7b5692017 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053900 Jan 31 17:09:56.107286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 224/465] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:09:56.346129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:56.347218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:56.356492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:56.357642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:56.371284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.373002 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.374090 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.375275 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.376633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.377087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.381836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.385923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.463663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.464472 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.465465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lazy-loading 'fault' on Instance uuid f4b08c77-2b9e-4c14-beed-8feae52e5b84 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:09:56.561659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:56.580899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4c3ba8f9-c488-4b7c-b927-01761714dc5c tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1304 microversion: 2.1 time: 0.237240 Jan 31 17:09:56.582181 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 242/466] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:56 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1304 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:56.692629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:56.703528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7f44080b-28a2-4e82-833a-af8b84cee474 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1509 microversion: 2.1 time: 0.352280 Jan 31 17:09:56.710079 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 225/467] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:56 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:56.757097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:56.758601 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:56.765420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.766118 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.767254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:56.767698 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:56.963334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:56.978966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-12ef67d7-d4f9-4b3c-80aa-ca380b68d3fb tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.224942 Jan 31 17:09:56.995922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 243/468] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:56 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:57.598673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:57.610223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:57.623263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:57.624149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:57.625613 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:57.626268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:57.681407 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:57.681864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:57.682323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lazy-loading 'fault' on Instance uuid f4b08c77-2b9e-4c14-beed-8feae52e5b84 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:09:57.721870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:57.722871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:57.738773 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:57.740920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:57.745818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:57.746666 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:57.800070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c238df167884c2fa93569d4b231afcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff165bd619436cb3de649388117b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:57.809881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-68c58c63-f141-4945-b734-f03a3de89b57 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 200 len: 1304 microversion: 2.1 time: 0.214812 Jan 31 17:09:57.810469 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 226/469] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:57 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:58.003113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:58.003859 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:58.016059 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:58.016558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:58.017373 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:58.017810 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:58.157966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:58.194738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cc1f667a-0faa-4737-b4b3-730523b7c196 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1515 microversion: 2.1 time: 0.476101 Jan 31 17:09:58.209621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 244/470] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:57 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1515 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:09:58.414421 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:58.429155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e18a52d8-b17f-48cc-81b9-81cfba0e8a2f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.429627 Jan 31 17:09:58.430896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 227/471] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:57 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:58.829080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:58.829985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] [instance: f4b08c77-2b9e-4c14-beed-8feae52e5b84] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:58.845700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:58.846171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:58.847025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:58.847479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:58.876044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] HTTP exception thrown: Instance f4b08c77-2b9e-4c14-beed-8feae52e5b84 could not be found. Jan 31 17:09:58.877849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] Returning 404 to user: Instance f4b08c77-2b9e-4c14-beed-8feae52e5b84 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:09:58.879438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d96c4aee-77ee-4b3d-8756-3dcdad376289 tempest-VolumesActionsTest-754541861 tempest-VolumesActionsTest-754541861-project] 10.222.0.91 "GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84" status: 404 len: 111 microversion: 2.1 time: 0.054878 Jan 31 17:09:58.881083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 245/472] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:58 2022] GET /compute/v2.1/servers/f4b08c77-2b9e-4c14-beed-8feae52e5b84 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:09:59.447257 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:59.447878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:59.458335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:59.460409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:59.468272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:59.468828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:59.777948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:09:59.794752 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-23131a96-9e8f-4390-b862-4240ca12f6e0 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.351684 Jan 31 17:09:59.804314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 228/473] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:59 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:09:59.864340 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:09:59.864938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:09:59.888307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:59.889246 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:09:59.891448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:09:59.892040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:00.097749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:00.118925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1011d17d-714c-45d9-9345-a6e62695bf00 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1515 microversion: 2.1 time: 0.253877 Jan 31 17:10:00.122853 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 246/474] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:09:59 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:00.136061 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3584678-1969-42f9-9cb7-f893123e8972"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:00.137344 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:00.144729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:00.145869 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:00.146809 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:00.147628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:00.549790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6ea7cffb-398b-42c3-bb97-30f8f41047a6 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417427 Jan 31 17:10:00.551062 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 229/475] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:10:00 2022] POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:10:00.812199 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:00.813230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:00.819948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5d13bbad-66ba-424d-a6dc-9f3db802d9fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Action: 'create', calling method: .version_select at 0x7fdce338d3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1997291081"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:00.820133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:00.821000 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:00.821900 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:00.822413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:00.833793 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-5d13bbad-66ba-424d-a6dc-9f3db802d9fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Getting quotas for project 3ef9d07877504c04a9a1062d34b7a80b. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:10:00.838530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-5d13bbad-66ba-424d-a6dc-9f3db802d9fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Getting quotas for user 5d79ec01357e4f48bbe83852d2871d6d and project 3ef9d07877504c04a9a1062d34b7a80b. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:10:00.977608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:00.984866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cd70d327-acb2-4d5a-a5cb-69421d74d4a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.177393 Jan 31 17:10:00.985423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 230/476] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:00 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:01.150976 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-5d13bbad-66ba-424d-a6dc-9f3db802d9fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Getting quotas for project 3ef9d07877504c04a9a1062d34b7a80b. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:10:01.155073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-5d13bbad-66ba-424d-a6dc-9f3db802d9fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Getting quotas for user 5d79ec01357e4f48bbe83852d2871d6d and project 3ef9d07877504c04a9a1062d34b7a80b. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:10:01.168332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5d13bbad-66ba-424d-a6dc-9f3db802d9fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.545146 Jan 31 17:10:01.168908 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 247/477] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Jan 31 17:10:00 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:02.003016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:02.004245 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:02.012886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:02.013352 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:02.014879 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:02.015261 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:02.179014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:02.188580 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bc40511e-be52-4df5-b4a5-8904209f91e8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.190194 Jan 31 17:10:02.189030 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 231/478] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:01 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:03.206375 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:03.207709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:03.216096 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:03.216740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:03.217542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:03.217981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:03.363243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:03.370787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cc352729-869a-4bb0-a0c6-aed4f8b8e51f tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.168899 Jan 31 17:10:03.371357 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 248/479] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:03 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:04.388353 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:04.389124 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:04.395683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:04.396248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:04.397052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:04.397499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:04.539294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:04.546589 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-27985a9a-cf5e-43f5-86d1-17331d6b1bac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.162489 Jan 31 17:10:04.547149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 232/480] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:04 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:05.563996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:05.564634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:05.572352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:05.572804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:05.573580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:05.574042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:05.713314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:05.720502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-190f6fca-a780-4366-8885-53bbca28e482 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.160424 Jan 31 17:10:05.721068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 249/481] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:05 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:06.737619 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:06.738238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:06.744877 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:06.745339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:06.746124 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:06.746570 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:06.886004 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:06.893212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0ba953c9-0abf-4835-a670-ee35a7116d99 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.159293 Jan 31 17:10:06.894003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 233/482] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:06 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:07.691667 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-768ee494-8642-4d3e-9347-0f9f47f7e2a2 req-4dadd914-f178-4ab3-9766-a090a4ddaedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9693f6d0-87a8-4064-8c0c-de845eb1ea58", "name": "network-vif-plugged", "status": "completed", "tag": "559ede79-4a4a-4a5d-8f03-35f44dd495b1"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:07.693260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:10:07.693260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:10:07.701636 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-768ee494-8642-4d3e-9347-0f9f47f7e2a2 req-4dadd914-f178-4ab3-9766-a090a4ddaedc service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:07.702071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-768ee494-8642-4d3e-9347-0f9f47f7e2a2 req-4dadd914-f178-4ab3-9766-a090a4ddaedc service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:07.713162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-768ee494-8642-4d3e-9347-0f9f47f7e2a2 req-4dadd914-f178-4ab3-9766-a090a4ddaedc service nova] Creating event network-vif-plugged:559ede79-4a4a-4a5d-8f03-35f44dd495b1 for instance 9693f6d0-87a8-4064-8c0c-de845eb1ea58 on hv-cinder-81566 Jan 31 17:10:07.718190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-768ee494-8642-4d3e-9347-0f9f47f7e2a2 req-4dadd914-f178-4ab3-9766-a090a4ddaedc service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030195 Jan 31 17:10:07.718957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 250/483] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:10:07.910111 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:07.910979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:07.919116 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:07.919698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:07.920664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:07.921218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:08.043379 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfaf7659-bb9f-4936-9b95-105dd6030af3"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:08.044786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:08.050884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:08.051226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:08.052013 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:08.052503 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:08.111438 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:08.119058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1c95bd87-e298-4315-b207-f910bb466cb4 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.212510 Jan 31 17:10:08.128812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 234/484] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:07 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:09.142226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:09.143818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:09.162603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:09.162603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:09.162603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:09.163335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:09.313294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-79dbbee2-7f34-49df-96b8-2be3fc968f2f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.274325 Jan 31 17:10:09.315473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 251/485] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:10:08 2022] POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-volume_attachments => generated 194 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:10:09.470615 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:09.480384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-54c966d3-57fb-4a83-9480-d0b87e097327 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.348012 Jan 31 17:10:09.491819 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 235/486] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:09 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:10.498153 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:10.498856 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:10.505353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:10.505809 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:10.506585 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:10.507054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:10.650160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:10.658058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-95730260-1750-4b30-93ad-4dc366cadd1d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1318 microversion: 2.1 time: 0.164333 Jan 31 17:10:10.658630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 252/487] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:10 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:11.673899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:11.674478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:11.681559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:11.682014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:11.682802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:11.683243 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:11.824305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:11.832048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-05f271b0-50a9-4ea3-b2a0-2d16ee3d19fc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1507 microversion: 2.1 time: 0.161812 Jan 31 17:10:11.832637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 236/488] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:11 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:14.282962 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce77db39-eb83-46da-b0a3-2d5f7dd4f266"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:14.284121 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:14.291762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:14.292979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:14.293188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:14.293820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:14.674018 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e3bde5fd-459a-4b30-99c5-6d26f143ebb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "POST /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394787 Jan 31 17:10:14.674796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 253/489] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:10:14 2022] POST /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:10:17.598660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:17.599690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:17.606912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:17.607365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:17.608169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:17.608609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:17.633620 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lazy-loading 'flavor' on Instance uuid 1ee59a59-7ed3-4b35-8a54-a257556f657c {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:10:17.765528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2db9df61-a7ef-4370-abf1-4ea1f6aa1000 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action" status: 200 len: 32 microversion: 2.1 time: 0.170380 Jan 31 17:10:17.766290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 237/490] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:10:17 2022] POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:10:17.777132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:17.778458 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:17.787328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:17.788198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:17.789413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:17.790091 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:17.977260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:17.986565 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0fa3e39a-a597-4156-9d40-bd7cfd82bb61 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.214831 Jan 31 17:10:17.987478 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 254/491] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:17 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:18.243498 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:18.244422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:18.250781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:18.251243 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:18.252047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:18.252512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:18.279167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lazy-loading 'flavor' on Instance uuid 7c80add9-d970-4aae-9ab5-6df59903b074 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:10:19.004366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:19.004980 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:19.011221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:19.011679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:19.012493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:19.012936 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:19.152996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:19.161592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-80e741a4-ecbb-4609-94b1-f65295ae31be tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.160790 Jan 31 17:10:19.162481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 255/492] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:18 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:20.180211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:20.180938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:20.187301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:20.187755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:20.188573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:20.189069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:20.329749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:20.339397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1696bb08-5b58-4387-94c9-530e0df0dd79 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.163348 Jan 31 17:10:20.339976 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 256/493] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:20 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:21.357614 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:21.358296 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:21.365183 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:21.365870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:21.367289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:21.367736 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:21.513679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:21.521632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0183edef-1324-4a67-9839-b10b5ac22657 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.167815 Jan 31 17:10:21.522820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 257/494] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:21 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:22.539543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:22.540310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:22.547376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:22.547908 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:22.548794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:22.549543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:22.713091 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:22.719629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-373ac9a6-0588-44b2-94be-795abde8d8d1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.183932 Jan 31 17:10:22.720473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 258/495] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:22 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:23.740578 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:23.742611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:23.749868 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:23.750327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:23.751325 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:23.751780 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:23.903458 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:23.912065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0531ed9b-3d97-46ab-9fa7-a06b65e5a7bd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.175751 Jan 31 17:10:23.912911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 259/496] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:23 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:24.929430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:24.930185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:24.937160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:24.937629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:24.938408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:24.938882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:25.091484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:25.099956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f07da89e-d31a-4477-9c9e-0d3dfa2d0081 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.174656 Jan 31 17:10:25.101342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 260/497] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:24 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:26.118797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:26.119860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:26.126693 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:26.127148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:26.127945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:26.128437 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:26.275313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:26.283836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a61c1353-e9e9-4186-979e-bbe62ef21c78 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.168837 Jan 31 17:10:26.284484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 261/498] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:26 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:27.300890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:27.301575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:27.308963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:27.309572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:27.310626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:27.311281 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:27.492917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:27.501193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-12855c88-6186-49d2-a551-be13dcfe3b98 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.203942 Jan 31 17:10:27.501742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 262/499] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:27 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:27.506710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a28dbeb7-9282-42ed-ac66-fc26d4916f50 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:27.513205 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a28dbeb7-9282-42ed-ac66-fc26d4916f50 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:27.513674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a28dbeb7-9282-42ed-ac66-fc26d4916f50 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:27.577654 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a28dbeb7-9282-42ed-ac66-fc26d4916f50 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Going to try to stop instance {{(pid=116483) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 31 17:10:27.630443 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a28dbeb7-9282-42ed-ac66-fc26d4916f50 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action" status: 202 len: 0 microversion: 2.1 time: 0.127072 Jan 31 17:10:27.630975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 263/500] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:10:27 2022] POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:10:27.640501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:27.641213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:27.648144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:27.648875 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:27.649687 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:27.650143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:27.803943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:27.811940 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-119d23ea-6af5-4127-9ab8-8bbadcc7a900 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.175636 Jan 31 17:10:27.812844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 264/501] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:27 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:28.521613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:28.523313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:28.529924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:28.530487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:28.531357 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:28.531808 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:28.694949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:28.705681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56636a6a-b31f-467a-97bb-cf6232735d37 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.190101 Jan 31 17:10:28.706271 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 265/502] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:28 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:28.831708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:28.832423 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:28.840557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:28.841874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:28.842919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:28.843557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:29.027930 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:29.039072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-131b4686-7a98-43d8-8f35-8ff75b34b07b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.211650 Jan 31 17:10:29.040321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 266/503] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:28 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:29.726291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:29.727062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:29.734033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:29.734581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:29.735388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:29.735875 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:29.878418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:29.887557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b97cea2d-64b8-42ef-87d8-cc2d92b93cfe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.165920 Jan 31 17:10:29.888513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 267/504] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:29 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:30.057621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:30.058234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:30.064189 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:30.064632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:30.065595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:30.065892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:30.217948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:30.227410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ea646e1a-3923-4f22-b109-3a626c66aff3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.173557 Jan 31 17:10:30.238462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 268/505] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:30 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:30.904975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:30.905711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:30.911876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:30.912382 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:30.913716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:30.914155 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:31.059594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:31.071100 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0e46ee29-bfa2-458c-b59c-e53d4f0e75cf tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.169558 Jan 31 17:10:31.082258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 269/506] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:30 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:31.246272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:31.247005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:31.253770 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:31.254248 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:31.255030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:31.255468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:31.401869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:31.409608 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-098b062d-4b3b-4af6-88c4-0147e2de5100 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.166996 Jan 31 17:10:31.410171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 270/507] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:31 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:32.090293 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:32.090911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:32.097080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:32.097541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:32.098328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:32.098775 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:32.242564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:32.251352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9799649b-6536-4fce-8033-7a043ef83e9d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.164764 Jan 31 17:10:32.253979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 271/508] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:32 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:32.426421 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:32.427041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:32.433182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:32.433639 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:32.434435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:32.434885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:32.576668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:32.587815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7d9abe40-0112-4153-b7e2-b8e2395a965a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.164816 Jan 31 17:10:32.588424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 272/509] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:32 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:33.268533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:33.269525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:33.276015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:33.276522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:33.277318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:33.277768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:33.418224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:33.428610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-def28c4a-0de8-4dac-8091-bcc4d1144656 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.162671 Jan 31 17:10:33.429834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 273/510] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:33 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:33.605451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:33.605985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:33.612521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:33.612973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:33.613826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:33.614377 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:33.760210 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:33.769330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8db60291-0e6d-473b-b61b-d435413a7355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.168073 Jan 31 17:10:33.770115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 274/511] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:33 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:34.446191 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:34.446840 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:34.453264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:34.453728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:34.454525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:34.454964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:34.611247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:34.624903 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9f5bf969-c47b-4954-af8d-470121b8ad74 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.182637 Jan 31 17:10:34.634580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 275/512] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:34 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:34.794850 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:34.795992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:34.806185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:34.806912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:34.808242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:34.808998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:34.978385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:34.986998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8b4c3183-5a45-464a-9b22-dd2b302b781a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.200641 Jan 31 17:10:34.987649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 276/513] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:34 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:35.642119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:35.642943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:35.650244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:35.650706 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:35.651515 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:35.652015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:35.797678 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:35.807134 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8b3da33c-ccb6-42f4-b2d7-3ef42292f24d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.168708 Jan 31 17:10:35.807739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 277/514] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:35 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:36.006663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:36.007603 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:36.014884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:36.015502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:36.016344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:36.017174 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:36.165530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:36.173852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bba7e204-cc11-4a9b-88db-9a23e2fdb27b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.171554 Jan 31 17:10:36.174420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 278/515] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:36 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:36.826822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:36.827847 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:36.836289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:36.836747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:36.837879 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:36.838375 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:37.027265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:37.038967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cffdcdae-a17e-4def-b1e9-23ee007ad1ea tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.216830 Jan 31 17:10:37.039655 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 279/516] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:36 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:37.191929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:37.192604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:37.199435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:37.199885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:37.200786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:37.201232 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:37.362974 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:37.371640 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-58b947c4-c612-4327-a7e7-a7438552f55f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.183377 Jan 31 17:10:37.376148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 280/517] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:37 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:38.056383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:38.057119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:38.063591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:38.064038 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:38.064869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:38.065318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:38.218732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:38.227359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-80f9cb19-0fbb-456e-8dcf-5ba85c2c7b8e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.174673 Jan 31 17:10:38.227947 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 281/518] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:38 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:38.390107 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:38.390724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:38.398050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:38.398730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:38.399662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:38.400144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:38.618543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:38.632223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-afb2876a-906b-4181-8481-ab39d772f3ad tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.246052 Jan 31 17:10:38.640302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 282/519] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:38 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:39.245181 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:39.246184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:39.257078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:39.257078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:39.257078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:39.257078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:39.466869 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:39.477757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bd6d4863-25d4-474d-b94d-ab77df85f50f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.236393 Jan 31 17:10:39.478354 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 283/520] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:39 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:39.650883 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:39.651432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:39.657577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:39.658028 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:39.658925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:39.659949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:39.812270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:39.820709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e8c37082-334a-4a1c-8c7c-4b67801ecbd8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.174556 Jan 31 17:10:39.821284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 284/521] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:39 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:40.296615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:40.297844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:40.304202 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.304749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.305873 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.306473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.414255 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'services' on Instance uuid 9693f6d0-87a8-4064-8c0c-de845eb1ea58 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:10:40.513444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8ed04ad8-5d31-43b0-a423-8903310d12dc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments/ce77db39-eb83-46da-b0a3-2d5f7dd4f266" status: 202 len: 0 microversion: 2.1 time: 0.220339 Jan 31 17:10:40.514434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 285/522] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:10:40 2022] DELETE /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments/ce77db39-eb83-46da-b0a3-2d5f7dd4f266 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:10:40.525314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:40.526491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:40.535353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.535933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.536775 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.537419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.698184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:40.706264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-df542d23-5dcc-4441-9623-132221fa474a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.190125 Jan 31 17:10:40.706851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 286/523] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:40 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:40.712909 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:40.714096 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:40.720347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.720806 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.721660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.722184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.756800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-46afec49-9c40-4abc-b4b4-9c4e1de4ba2a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Jan 31 17:10:40.757358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 287/524] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:10:40 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:10:40.838290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:40.838983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:40.845546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.846009 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.846805 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:40.847252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:40.993191 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:41.001774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f663f30d-a08c-4cdd-8bc7-ff69b1a30e10 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.167584 Jan 31 17:10:41.002381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 288/525] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:40 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:41.723666 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:41.724348 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:41.731393 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:41.731843 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:41.732677 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:41.733114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:41.879741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:41.890064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56b0f543-880a-47ca-8302-d65fe74c2754 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.168921 Jan 31 17:10:41.897542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 289/526] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:41 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:41.897542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:41.897542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:41.904285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:41.904739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:41.906014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:41.906524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:41.942211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-78e58966-9f91-468a-9514-4448f0d0351b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049998 Jan 31 17:10:41.942789 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 290/527] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:10:41 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:10:42.019456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:42.020063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:42.028938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:42.029431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:42.030293 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:42.030877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:42.175906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:42.188553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-81a3dc7f-69b2-486d-b88e-9fd17b49851f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.172810 Jan 31 17:10:42.189600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 291/528] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:42 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:42.908243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:42.908890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:42.917461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:42.917921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:42.918721 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:42.919163 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:43.067706 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:43.076151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b8c1ef50-f1a5-41f4-a8f6-cf6214e3326e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.171796 Jan 31 17:10:43.076726 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 292/529] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:42 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:43.081117 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:43.082024 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:43.088713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:43.089169 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:43.089966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:43.090418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:43.121603 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-726f3923-3e9e-44e6-b1b6-676f5246f55b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043791 Jan 31 17:10:43.122196 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 293/530] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:10:43 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:10:43.207436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:43.208051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:43.215839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:43.216321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:43.217132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:43.217576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:43.371895 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:43.381399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d6738690-6386-4b18-adee-3a61c703bd20 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.177040 Jan 31 17:10:43.381999 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 294/531] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:43 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:44.095626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:44.096966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:44.108923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.110258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.111897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.112502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.274846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:44.283743 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4af088ec-a26c-462b-9708-fee2ce308a03 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.193780 Jan 31 17:10:44.284356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 295/532] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:44 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:44.364886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:44.366451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:44.373682 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.374614 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.378291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.378913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.427876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Going to try to terminate instance {{(pid=116483) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:10:44.570501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-52856691-7e3e-4bd1-8fec-53b5eb2e5760 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 204 len: 0 microversion: 2.1 time: 0.217074 Jan 31 17:10:44.574045 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 296/533] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:10:44 2022] DELETE /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:10:44.579231 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:44.580115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:44.589993 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.590678 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.591876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.592853 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.673822 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e10fc763-d7f3-4100-83de-25b17cfb6efa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/action" status: 202 len: 0 microversion: 2.20 time: 26.434641 Jan 31 17:10:44.674694 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 238/534] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Jan 31 17:10:18 2022] POST /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/action => generated 0 bytes in 26437 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:10:44.684643 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:44.685697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:44.694339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.695073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.696253 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.696845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.875058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:44.888861 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d8464710-b740-44c3-9749-da07fa4d723d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.310345 Jan 31 17:10:44.899178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 297/535] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:44 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:44.899178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:44.899178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:44.905711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.906025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.906884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:44.907331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:44.947854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:44.957320 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a85d842c-f486-42dd-ab5b-c1ad0ebe603a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1513 microversion: 2.1 time: 0.279933 Jan 31 17:10:44.969542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 239/536] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:44 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1513 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:45.089052 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:45.100371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:45.100371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:45.101042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b474ac00-2acb-4540-928f-d99f124d4e45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.210018 Jan 31 17:10:45.101042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 298/537] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:44 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:45.303204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:45.303917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:45.312951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:45.312951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:45.312951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:45.312951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:45.466684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:45.476590 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c8df5745-c7c1-4176-b350-6746b170eab2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.177657 Jan 31 17:10:45.477262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 240/538] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:45 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:45.910197 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:45.911405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:45.925241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:45.925738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:45.926901 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:45.928047 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:45.978134 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:45.980030 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:46.003197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:46.003869 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:46.007847 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:46.010037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:46.463704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:46.471222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b6e6f599-139f-4a67-aca7-41a9552b4c0a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1513 microversion: 2.1 time: 0.499875 Jan 31 17:10:46.471872 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 241/539] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:45 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:46.472399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:46.478587 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:46.479543 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:46.486064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:46.486520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:46.486829 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0105772c-0f4a-47f6-8ede-02b8d44b623d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.578009 Jan 31 17:10:46.487651 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:46.487926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:46.488055 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 299/540] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:45 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:46.497252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:46.498490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:46.516522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:46.517501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:46.518762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:46.519411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:46.689302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:46.697794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:46.699709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:46.701359 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-750ac675-f59c-44b6-b2ee-7451d68c87c2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.227496 Jan 31 17:10:46.703399 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 242/541] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:46 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:46.768211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:46.778482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-37c76805-653c-4889-a64f-48b088e28f9f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.284815 Jan 31 17:10:46.788749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 300/542] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:46 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:47.489136 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:47.490357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:47.496784 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.497641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.498934 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.499576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.505386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:47.506994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:47.516745 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.521830 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.526387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.530467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.782334 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:47.795664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:47.799640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-57734b7a-b395-4201-95c4-3f81e8c25ecc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1513 microversion: 2.1 time: 0.309371 Jan 31 17:10:47.801150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 243/543] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:47 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:47.806302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-dcc3d611-ba0e-4e65-bc54-86278af829fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.304542 Jan 31 17:10:47.806884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:47.807067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 301/544] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:47 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:47.807866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:47.813381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:47.814158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:47.815919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.816515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.817316 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.817779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.834680 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.835543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:47.836709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:47.837695 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:48.195447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:48.204309 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:48.204661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:48.208190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:48.214013 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8f9bc4d6-ad35-4f85-a3f9-7f75610f7cff tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.405799 Jan 31 17:10:48.214623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 302/545] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:47 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:48.215844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e850789d-5f10-44ed-a286-1849f55d345c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.413287 Jan 31 17:10:48.216884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 244/546] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:47 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:48.393651 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:10:48.393981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: Mon Jan 31 17:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:10:48.817959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:48.820716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:48.836094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:48.842352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:48.843943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:48.844996 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:48.845493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:48.846327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:48.858210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:48.858673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:48.859492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:48.859941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:49.286056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:49.301031 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8c75c45f-09b7-4034-b31e-d1466c1cdb6e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.466996 Jan 31 17:10:49.302191 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 245/547] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:48 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:49.309578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:49.317635 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:49.331528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:49.335115 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:49.337614 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:49.339061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:49.339862 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:49.347858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-204680bd-a8e6-4c8d-983b-a2306547fa3c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1513 microversion: 2.1 time: 0.534062 Jan 31 17:10:49.356419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 303/548] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:48 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1513 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:49.364284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:49.365200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:49.379913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:49.380962 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:49.385759 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:49.386233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:49.945408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:49.957936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7de49378-07f8-4dd3-94a0-93260c11463a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.654421 Jan 31 17:10:49.968503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 246/549] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:49 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:50.174290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:50.202671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:50.206023 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:50.211087 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7960744c-8b63-4e0d-b970-1f385d1fb449 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.853119 Jan 31 17:10:50.211907 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 304/550] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:49 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:50.322772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:50.323587 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:50.332882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:50.334162 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:50.337256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:50.340268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:50.372342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:50.373803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:50.389269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:50.390128 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:50.391274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:50.393228 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:50.883728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:50.897226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0da21e6a-7e02-47a6-9d12-e52aee6ab4db tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.576983 Jan 31 17:10:50.906626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 247/551] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:50 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:50.929413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:50.962479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-33224d0b-da47-47b4-ae4c-de5ac70508f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1513 microversion: 2.1 time: 0.597882 Jan 31 17:10:50.972361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 305/552] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:50 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1513 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:50.976680 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:50.977683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:50.988409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:50.993375 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:50.995096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:50.995564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:51.056660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-810b6c91-bdb0-4df0-b22c-58208eb0e401 req-4d64ccb3-c7df-4627-a2c5-57f87ef9638d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9693f6d0-87a8-4064-8c0c-de845eb1ea58", "name": "network-vif-deleted", "tag": "559ede79-4a4a-4a5d-8f03-35f44dd495b1"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:51.058689 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:10:51.058689 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:10:51.078701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-810b6c91-bdb0-4df0-b22c-58208eb0e401 req-4d64ccb3-c7df-4627-a2c5-57f87ef9638d service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:51.081882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-810b6c91-bdb0-4df0-b22c-58208eb0e401 req-4d64ccb3-c7df-4627-a2c5-57f87ef9638d service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:51.106177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-810b6c91-bdb0-4df0-b22c-58208eb0e401 req-4d64ccb3-c7df-4627-a2c5-57f87ef9638d service nova] Creating event network-vif-deleted:559ede79-4a4a-4a5d-8f03-35f44dd495b1 for instance 9693f6d0-87a8-4064-8c0c-de845eb1ea58 on hv-cinder-81566 Jan 31 17:10:51.117665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-810b6c91-bdb0-4df0-b22c-58208eb0e401 req-4d64ccb3-c7df-4627-a2c5-57f87ef9638d service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065302 Jan 31 17:10:51.119668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 306/553] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:10:51.232207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:51.233860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:51.243715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:51.244864 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:51.245963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:51.246424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:51.650951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:51.659935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7a2d1c86-b5bf-4ac8-a0da-f205240e7eca tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.688816 Jan 31 17:10:51.674886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 248/554] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:50 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:51.876626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:51.891106 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:51.900999 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:51.902572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-abce05bf-5edb-4ed2-bf3e-c999930d14eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.674688 Jan 31 17:10:51.903217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 307/555] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:51 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:10:51.937399 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:51.938431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:51.947779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:51.948347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:51.949159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:51.949594 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:51.980238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:51.980874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:51.992448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:51.993149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:52.006627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:52.007842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:52.105700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:52.106160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:52.106630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid 9693f6d0-87a8-4064-8c0c-de845eb1ea58 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:10:52.172087 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:52.184727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1b405ac8-a44a-456a-96e2-70a979134483 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 200 len: 1308 microversion: 2.1 time: 0.208776 Jan 31 17:10:52.190320 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 308/556] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:51 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:52.334696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:52.350566 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-61734d09-6e04-4285-9347-6c358c21e676 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.418991 Jan 31 17:10:52.356514 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 249/557] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:51 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:52.682557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:52.682960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:52.693577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:52.694697 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:52.695540 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:52.698251 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:52.933123 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:52.934703 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:52.970620 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:52.972699 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:52.974226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:52.976698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:53.024175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:53.037526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f93d1c23-b77a-4ef1-a802-79ce4a59bec2 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.359244 Jan 31 17:10:53.047927 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 309/558] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:52 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:53.205309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:53.206176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 9693f6d0-87a8-4064-8c0c-de845eb1ea58] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:53.215514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:53.216363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:53.217463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:53.218065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:53.238014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] HTTP exception thrown: Instance 9693f6d0-87a8-4064-8c0c-de845eb1ea58 could not be found. Jan 31 17:10:53.238952 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Returning 404 to user: Instance 9693f6d0-87a8-4064-8c0c-de845eb1ea58 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:10:53.240226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1057aa68-672c-455d-b57f-f8ba1924d3ce tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58" status: 404 len: 111 microversion: 2.1 time: 0.041990 Jan 31 17:10:53.242212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 310/559] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:53 2022] GET /compute/v2.1/servers/9693f6d0-87a8-4064-8c0c-de845eb1ea58 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:10:53.340983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:53.351310 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:53.354484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:53.355864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-273d8318-ecce-48f0-874c-030f8da317e7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.437485 Jan 31 17:10:53.357328 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 250/560] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:52 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:53.378247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:53.378764 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:53.395304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:53.398751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:53.401545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:53.403222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:53.566763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-661643163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1997291081", "security_groups": [{"name": "tempest-secgroup-smoke-955373446"}], "networks": [{"uuid": "30f684ec-4abc-4f18-a37c-cd932c88d435"}], "block_device_mapping_v2": [{"uuid": "c2ecb1e1-ee21-4fe7-aa16-622f52163d3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:10:53.594837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:53.626742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6cf2dc3e-9ecd-4a3e-bd13-028a34fdd7e4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.257587 Jan 31 17:10:53.631637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 311/561] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:53 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:53.744861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] validate_networks() for [('30f684ec-4abc-4f18-a37c-cd932c88d435', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:10:54.059966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:54.060774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:54.074321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.077162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.083105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.085799 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.495166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:54.507770 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d59f923a-1488-4aa5-b181-58b2c6c64ec8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.455811 Jan 31 17:10:54.508735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 312/562] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:54 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:54.515046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:54.515669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:54.535509 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.535970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.537446 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.537900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.550004 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:10:54.550568 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:10:54.550906 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:10:54.551327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:10:54.551749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:10:54.571601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.572065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.572920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.573366 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.608779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Getting quotas for project 3ef9d07877504c04a9a1062d34b7a80b. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:10:54.625690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Getting quotas for user 5d79ec01357e4f48bbe83852d2871d6d and project 3ef9d07877504c04a9a1062d34b7a80b. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:10:54.754307 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:10:54.756747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c2ecb1e1-ee21-4fe7-aa16-622f52163d3c',volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:10:54.827328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:54.839645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:54.845059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:54.846203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3d945656-26f2-4ebe-a729-e2884bd18312 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.336502 Jan 31 17:10:54.847290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 313/563] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:54 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:54.861740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:54.862942 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:54.878513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.881272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.882250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:54.884802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:54.949288 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Going to try to terminate instance {{(pid=116483) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:10:54.985120 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d167f044-6e7c-4f13-92cd-28ae389f584a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.422124 Jan 31 17:10:54.989255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 251/564] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:10:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:10:54.996917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:54.999451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:55.012371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.016403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.017500 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.018947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.168295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-10c2ae73-6821-4ec1-88f8-8f73b0d40226 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 204 len: 0 microversion: 2.1 time: 0.319270 Jan 31 17:10:55.169782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 314/565] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:10:54 2022] DELETE /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:10:55.179715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fb8e9a8d-c29c-4394-af92-9f1d21f6bb68 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:55.183724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fb8e9a8d-c29c-4394-af92-9f1d21f6bb68 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:55.295048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fb8e9a8d-c29c-4394-af92-9f1d21f6bb68 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:55.302451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fb8e9a8d-c29c-4394-af92-9f1d21f6bb68 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1088 microversion: 2.1 time: 0.130852 Jan 31 17:10:55.302831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 315/566] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:55 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1088 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:55.319017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:55.330966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:55.345855 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.362163 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.367874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.369319 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.403598 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:55.417355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d9739df3-46c9-4789-bf64-0d48c23b7ecf tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.424063 Jan 31 17:10:55.429958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 252/567] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:54 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:55.525439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:55.527443 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:55.539828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.540501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.541420 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.541971 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.859864 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:55.868072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-94330db3-f958-4481-aadf-204b88fed461 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1513 microversion: 2.1 time: 0.561518 Jan 31 17:10:55.868688 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 316/568] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:55 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1513 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:55.878139 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:55.879044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:55.897877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.898624 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:55.899816 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:55.902361 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:56.092805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:56.101556 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-160f5141-ee2e-406d-bac8-3b420833ab5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.580281 Jan 31 17:10:56.108447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 253/569] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:55 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:56.288489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:56.302471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:56.304555 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:56.305820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7de00b02-e722-41ea-a741-14a7f187161f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.434371 Jan 31 17:10:56.331284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 317/570] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:55 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:56.345421 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:56.346472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:56.360504 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:56.361118 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:56.361821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:56.368827 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:56.437149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:56.438053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:56.448456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:56.449128 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:56.455232 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:56.455870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:56.529154 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:56.536934 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-63ca2b35-41b9-49c8-8e55-371a9b6e4fe1 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1130 microversion: 2.1 time: 0.218848 Jan 31 17:10:56.543190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 254/571] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:56 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1130 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:56.731596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:56.742676 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5789c999-7d5f-42f8-b999-94068223d4b4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.311364 Jan 31 17:10:56.754913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 318/572] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:56 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:56.886851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:56.887769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:56.900664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:56.903678 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:56.904924 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:56.905721 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.106194 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:57.119911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:57.121301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:57.126385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7e169109-85b6-4619-a5e2-f40f30d080a8 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1513 microversion: 2.1 time: 0.243594 Jan 31 17:10:57.132305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 255/573] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:56 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:57.132964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.133590 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.134555 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.135157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.325413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:57.326165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:57.333086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.335896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.337634 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.338317 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.436291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:57.469931 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8e709d88-41a3-46dc-a9ba-af22c85c66cb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.354339 Jan 31 17:10:57.475619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 319/574] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:57 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:57.559360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:57.560291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:57.572935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.574109 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.579021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.580030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.599788 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:57.616752 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:57.618649 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:57.620656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-df63b22e-d6ae-452c-85a4-fca91fe32746 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.299457 Jan 31 17:10:57.621881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 256/575] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:57 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:10:57.767157 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:57.767768 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:57.778236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.778697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.779499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:57.779938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:57.807046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:57.820753 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e58831ce-0a1e-4721-b906-afb6585f3c9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1194 microversion: 2.1 time: 0.264460 Jan 31 17:10:57.822641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 320/576] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:57 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:58.149025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:58.149898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:58.159511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:58.160309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:58.161844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:58.162964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:58.345973 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:58.357437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-292757ea-1a4e-4720-be30-862f3b774703 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.594658 Jan 31 17:10:58.363702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 257/577] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:57 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:58.501153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:58.501840 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:58.510910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:58.511369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:58.512323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:58.512762 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:58.615883 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:58.643554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bc138699-2762-40d5-b9f6-716c538a5a56 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1513 microversion: 2.1 time: 0.492687 Jan 31 17:10:58.645051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 321/578] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:58 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1513 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:10:58.669125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:58.672487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:58.683823 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:58.684563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:58.685554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:58.689412 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.037789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:59.048216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2a20ce87-2cf1-4997-84e3-e8e3edcfbdbd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.559077 Jan 31 17:10:59.064477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 258/579] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:58 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:59.071827 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:59.073401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:59.087088 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:59.090542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.091570 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:59.093313 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.199677 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:59.212585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-db8659b1-9941-4567-a388-3a4d44d6db9e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1204 microversion: 2.1 time: 0.146842 Jan 31 17:10:59.218095 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 259/580] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:59 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1204 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:10:59.323945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:59.338949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:59.345296 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:59.346899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-135c40d6-54e7-4089-a771-24ef4d728bfb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.699257 Jan 31 17:10:59.361999 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 322/581] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:10:58 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:10:59.382369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:59.382893 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:59.395040 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:59.396640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.402112 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:59.411767 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.662749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:10:59.663491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:10:59.672813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:59.685683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.687219 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:10:59.687896 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:10:59.843532 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:10:59.869540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f74760c3-5a5d-4d3a-a4a3-63fd6a2debbd tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.488090 Jan 31 17:10:59.870201 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 260/582] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:59 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:00.084408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:00.084899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:00.105210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:00.105665 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:00.106476 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:00.106916 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:00.294730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:00.305802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6b19ef15-ed2d-4a07-97ec-50a3d9d37c7e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1513 microversion: 2.1 time: 0.647152 Jan 31 17:11:00.311680 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 323/583] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:10:59 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1513 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:00.361730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:00.362429 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:00.374776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:00.382282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:00.383158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:00.383609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:00.760251 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:00.771070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-87651cd5-edc7-42c0-8c1d-d4bc4f6efd2f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.454202 Jan 31 17:11:00.784951 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 324/584] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:00 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:00.790144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:00.791121 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:00.800506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:00.801790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:00.803437 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:00.804129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:01.015958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:01.028171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-86fc3c9e-bffb-41b8-8699-85c52db6b16d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.959762 Jan 31 17:11:01.029519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 261/585] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:00 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:01.036641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:01.037684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:01.047629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:01.048647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:01.053292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:01.059019 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:01.844199 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:01.856844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:01.860531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:01.863545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8d1e857a-e83d-4c23-a939-c5ffb71d031b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 1.077050 Jan 31 17:11:01.881190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 325/586] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:00 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:01.881190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:01.881190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:01.885250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:01.885902 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:01.886725 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:01.887172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.060728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:02.071032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-47978904-af97-4b3a-a395-5086b8d5d64d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 1.039781 Jan 31 17:11:02.081395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 262/587] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:01 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:02.087645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:02.088475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:02.094972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.095773 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.097163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.097805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.398801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:02.412638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3b50eee0-c3e0-472b-a460-0b9ac7282eac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1513 microversion: 2.1 time: 0.540371 Jan 31 17:11:02.417633 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 326/588] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:01 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:02.424794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:02.425787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:02.432738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.433682 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.434501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.435391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.543192 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:02.550742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fcc9437f-bea9-46d1-954d-2c2828cb8c73 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.467917 Jan 31 17:11:02.551329 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 263/589] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:02 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:02.731998 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-486a2d33-ade2-4b1e-a7d6-353e2fc5aefd req-8b1e592f-e072-4d4b-b309-969fd5e1ba2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c409eb-9777-4683-b0bb-cc402bb60990", "name": "network-vif-deleted", "tag": "3ea7d77d-76d2-44b3-8124-cb9910b6c5e1"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:02.733659 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:02.733659 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:02.759221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-486a2d33-ade2-4b1e-a7d6-353e2fc5aefd req-8b1e592f-e072-4d4b-b309-969fd5e1ba2c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.760595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-486a2d33-ade2-4b1e-a7d6-353e2fc5aefd req-8b1e592f-e072-4d4b-b309-969fd5e1ba2c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.783194 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-486a2d33-ade2-4b1e-a7d6-353e2fc5aefd req-8b1e592f-e072-4d4b-b309-969fd5e1ba2c service nova] Creating event network-vif-deleted:3ea7d77d-76d2-44b3-8124-cb9910b6c5e1 for instance 48c409eb-9777-4683-b0bb-cc402bb60990 on hv-cinder-81566 Jan 31 17:11:02.808639 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-486a2d33-ade2-4b1e-a7d6-353e2fc5aefd req-8b1e592f-e072-4d4b-b309-969fd5e1ba2c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077866 Jan 31 17:11:02.811640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 264/590] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:02.890708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:02.891443 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:02.911451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.912789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:02.915915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:02.917000 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.110973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:03.131642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c8305bb5-e82b-42b2-8199-fe88e2a715f0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.707463 Jan 31 17:11:03.136757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 327/591] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:02 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:03.159838 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:03.165186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:03.180939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.188363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.190091 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.191607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.413753 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:03.429161 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:03.430883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:03.432073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-71fb7569-5cf0-4f33-98ae-d6cad722ec3a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.546139 Jan 31 17:11:03.432665 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 265/592] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:02 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:03.446536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:03.447459 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:03.462374 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.463163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.464199 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.464984 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.509824 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.510533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.511154 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid 48c409eb-9777-4683-b0bb-cc402bb60990 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:03.746494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:03.762436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:03.765275 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a39f9a76-a976-4d79-92f3-e8856a4bc607 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 200 len: 1308 microversion: 2.1 time: 0.331570 Jan 31 17:11:03.766387 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 266/593] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:03 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:03.772616 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:03.773432 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:03.780355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.781143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:03.781616 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4c5c2f5a-789d-4ddc-ad1a-5c2c9b80310a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.633641 Jan 31 17:11:03.782206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 328/594] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:03 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:03.793142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:03.796690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.154439 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:04.155119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:04.178391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.178610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.179305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.180005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.527869 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:04.537984 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e756809d-f18f-4f64-9078-a171a41d6581 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.770139 Jan 31 17:11:04.547669 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 267/595] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:03 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:04.576688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:04.577335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:04.602296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.611290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.613459 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.615782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.771584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:04.786713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4923cf82-bc48-41a5-9982-d2f96f3c6b22 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.636317 Jan 31 17:11:04.794159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 329/596] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:04 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:04.807292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:04.820431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 48c409eb-9777-4683-b0bb-cc402bb60990] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:04.836665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.837624 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.839029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.839668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.874415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] HTTP exception thrown: Instance 48c409eb-9777-4683-b0bb-cc402bb60990 could not be found. Jan 31 17:11:04.875634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Returning 404 to user: Instance 48c409eb-9777-4683-b0bb-cc402bb60990 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:11:04.878675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-45491ab1-b1db-4503-8862-3320198a7462 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990" status: 404 len: 111 microversion: 2.1 time: 0.083520 Jan 31 17:11:04.882403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 330/597] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:04 2022] GET /compute/v2.1/servers/48c409eb-9777-4683-b0bb-cc402bb60990 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:11:04.893335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:04.894298 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:04.907994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.908936 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.910010 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:04.910646 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:04.951109 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:04.974465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:04.983281 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:04.986724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6b3e1f56-186d-4c6a-a08a-af57b9500300 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.437762 Jan 31 17:11:04.991726 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 268/598] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:04 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:05.007128 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-893cb64c-4624-42a7-8f87-8fb86cda0d1c req-cb8f4e57-59ba-4594-8be3-e647fb70886c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:05.010674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:05.010674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:05.028322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-893cb64c-4624-42a7-8f87-8fb86cda0d1c req-cb8f4e57-59ba-4594-8be3-e647fb70886c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.031839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-893cb64c-4624-42a7-8f87-8fb86cda0d1c req-cb8f4e57-59ba-4594-8be3-e647fb70886c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.084978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-893cb64c-4624-42a7-8f87-8fb86cda0d1c req-cb8f4e57-59ba-4594-8be3-e647fb70886c service nova] Creating event network-changed:e7ff3fe5-09f9-4881-8621-ae4162f6a416 for instance 4cada1e7-b97c-481f-bb74-31b3721ef746 on hv-cinder-81566 Jan 31 17:11:05.091129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-893cb64c-4624-42a7-8f87-8fb86cda0d1c req-cb8f4e57-59ba-4594-8be3-e647fb70886c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096551 Jan 31 17:11:05.092018 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 269/599] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:05.100245 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:05.101420 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:05.117500 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.118152 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.119693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.120346 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.159186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:11:05.293770 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:05.303925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2bb6492e-5285-4337-abd2-253531c937fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.418802 Jan 31 17:11:05.313106 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 331/600] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:04 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:05.321597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-36a7eebd-a4a1-4786-a933-6589eec1358b tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 204 len: 0 microversion: 2.1 time: 0.227191 Jan 31 17:11:05.325963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 270/601] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:11:05 2022] DELETE /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:11:05.331198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:05.332041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:05.348157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.352048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.353946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.358116 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.565451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:05.567418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:05.584033 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.584581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.585416 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.585852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.648194 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:05.659407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-de15def4-7bdc-4c09-8815-3f65ad2af00a tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1514 microversion: 2.1 time: 0.330355 Jan 31 17:11:05.662802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 332/602] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:05 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:05.813072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:05.813759 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:05.830753 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.831199 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:05.833801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:05.835671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.091793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:06.099595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-33471941-1d69-459a-9444-ac81e6b3b950 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.538389 Jan 31 17:11:06.100175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 271/603] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:05 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:06.111391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:06.116238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:06.125276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:06.125704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.126645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:06.127277 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.468159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:06.487067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d22f686e-afe1-46d9-8258-eb67c5920a2f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.679747 Jan 31 17:11:06.507919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 333/604] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:05 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:06.515208 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:06.516068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:06.527455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:06.528171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.529159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:06.529758 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.803297 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:06.819880 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:06.821597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:06.822628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6bed2c21-53d5-4b40-89b7-c973d906d75f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.718263 Jan 31 17:11:06.823206 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 272/605] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:06 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:06.830977 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:06.831596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:06.854705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:06.855403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.856407 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:06.857010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:06.934808 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:06.945129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7963c714-6ea1-4542-9a47-4175b6ab2efa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1722 microversion: 2.1 time: 0.435650 Jan 31 17:11:06.948439 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 334/606] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:06 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:07.120212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:07.121082 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:07.138066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:07.140182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:07.141818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:07.143824 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:07.627423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:07.630397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:07.640598 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f1d9495c-cc50-4199-95c4-ee59acd01067 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1514 microversion: 2.1 time: 0.816200 Jan 31 17:11:07.650573 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 273/607] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:06 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1514 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:07.650920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d6d61443-e2c2-4d70-bf3e-530c28d7a5b5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.527787 Jan 31 17:11:07.650920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 335/608] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:07 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:07.653485 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:07.660439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:07.675691 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:07.678284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:07.680204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:07.685901 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:07.842636 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:07.843517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:07.851935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:07.852435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:07.853309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:07.853751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:07.995025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:08.047949 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ab490b60-45c3-40c8-9546-aa3d37cace3c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.402911 Jan 31 17:11:08.058921 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 274/609] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:07 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:08.069673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:08.070306 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:08.078739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.079227 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.080329 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.080841 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.141528 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:08.152300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:08.154388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:08.157164 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c5c34715-9ace-4235-bd3c-d5c2d467d971 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.318721 Jan 31 17:11:08.158667 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 336/610] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:07 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:08.269148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:08.282422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dcd7f733-0aca-41c8-bb6c-57293c2cf4e3 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1699 microversion: 2.1 time: 0.231968 Jan 31 17:11:08.284815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 275/611] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:08 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1699 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:08.301456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9c902cc2-657f-49c0-9368-49696a00e5e6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:08.311614 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9c902cc2-657f-49c0-9368-49696a00e5e6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.312338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9c902cc2-657f-49c0-9368-49696a00e5e6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.349224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9c902cc2-657f-49c0-9368-49696a00e5e6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Going to try to start instance {{(pid=116483) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 31 17:11:08.403663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9c902cc2-657f-49c0-9368-49696a00e5e6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action" status: 202 len: 0 microversion: 2.1 time: 0.106361 Jan 31 17:11:08.407770 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 337/612] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:11:08 2022] POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:11:08.413837 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:08.414871 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:08.423828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.424939 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.426246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.427745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.622262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:08.635730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4f5d393c-811e-439c-9ddf-bcd103627732 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1708 microversion: 2.1 time: 0.226393 Jan 31 17:11:08.636779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 276/613] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:08 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1708 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:08.658923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:08.659641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:08.666562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:08.667590 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:08.677005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.678397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.679474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.679919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.680459 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.680571 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:08.681650 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:08.682491 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.005443 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:09.016584 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-15a8d659-5380-4938-a0f1-d65ed406b426 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.353507 Jan 31 17:11:09.017367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:09.027259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ed9b260b-4ff1-45fb-8538-d2bfe079e85d tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1514 microversion: 2.1 time: 0.372654 Jan 31 17:11:09.027445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 277/614] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:08 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:09.032438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 338/615] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:08 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:09.073440 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:09.074457 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:09.083662 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:09.085222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.087924 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:09.088684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.179301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:09.180325 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:09.188776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:09.189233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.190217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:09.190656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.517486 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:09.526248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a2e572cc-8a8d-4cc0-82c2-61990d8c880b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.463055 Jan 31 17:11:09.527020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 278/616] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:09 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:09.639033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:09.650423 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:09.652036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:09.658235 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ce2fd965-c584-40e0-9acc-15cdc6a076de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.482530 Jan 31 17:11:09.666739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:09.667356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:09.672234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 339/617] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:09 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:09.689988 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:09.700859 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.702091 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:09.702693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:09.753745 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2139060069", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "31a980c3-946a-4acb-bd5e-eceadd945147"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:09.855452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] validate_networks() for [('31a980c3-946a-4acb-bd5e-eceadd945147', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:11:10.234007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:10.242047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b03898bb-09f7-4a77-a32f-b6fa8d906029 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1708 microversion: 2.1 time: 0.592830 Jan 31 17:11:10.242623 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 279/618] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:09 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1708 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:10.248939 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:10.249749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:10.257934 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.258696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.259674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.259926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.673231 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:10.684935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-65a57b27-afc6-4c03-89c1-8417d75de183 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.439554 Jan 31 17:11:10.686944 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 280/619] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:10 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:10.703358 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:10.704380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:10.711072 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.711448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.712282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.712719 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.725979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:11:10.726471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:11:10.726870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:11:10.727288 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:11:10.727735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:11:10.746566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.749205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.749586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.750083 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.750450 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.750948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid 4da00b7e-f9a6-4973-a402-aa55e327971b {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:10.752511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.784336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Getting quotas for project 5e68191762cc4f148363bbe05beac72c. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:11:10.790862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Getting quotas for user 626459efa95b420a8e1f473e2dfdd7df and project 5e68191762cc4f148363bbe05beac72c. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:11:10.800672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:10.806872 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:11:10.810581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:11:10.811806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0ba328d7-a979-437e-a6a7-0f44980de37c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 200 len: 1308 microversion: 2.1 time: 0.112499 Jan 31 17:11:10.812925 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 281/620] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:10 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:10.817927 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-a8059aed-e105-432e-8db3-6e7ef0cf2bc1 req-ddfafa1c-cd71-49b0-8bf4-1e1d057089a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da00b7e-f9a6-4973-a402-aa55e327971b", "name": "network-vif-deleted", "tag": "7d23fc7e-6d9a-44d4-b416-de0bb1353998"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:10.819750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:10.819750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:10.826935 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-a8059aed-e105-432e-8db3-6e7ef0cf2bc1 req-ddfafa1c-cd71-49b0-8bf4-1e1d057089a2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.827592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-a8059aed-e105-432e-8db3-6e7ef0cf2bc1 req-ddfafa1c-cd71-49b0-8bf4-1e1d057089a2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.841866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-a8059aed-e105-432e-8db3-6e7ef0cf2bc1 req-ddfafa1c-cd71-49b0-8bf4-1e1d057089a2 service nova] Creating event network-vif-deleted:7d23fc7e-6d9a-44d4-b416-de0bb1353998 for instance 4da00b7e-f9a6-4973-a402-aa55e327971b on hv-cinder-81566 Jan 31 17:11:10.846841 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-a8059aed-e105-432e-8db3-6e7ef0cf2bc1 req-ddfafa1c-cd71-49b0-8bf4-1e1d057089a2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032600 Jan 31 17:11:10.847534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 282/621] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:10.854084 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:10.855810 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:10.861600 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.862058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.863566 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.863566 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.873814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-86109952-acdc-4695-a3ce-0c11e7e04ab8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122610 Jan 31 17:11:10.879855 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 340/622] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:11:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:11:10.888803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:10.892334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:10.900910 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.901374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:10.902184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:10.902630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.114697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.122478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fe492fbb-7a2f-4ec2-8a8f-62a274a3473b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.272932 Jan 31 17:11:11.129222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 283/623] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:10 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:11.132558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.137609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2f02c563-3f6d-41fe-828f-abf87723fa00 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:11.138627 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2f02c563-3f6d-41fe-828f-abf87723fa00 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:11.141960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.143471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.144675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cba5e39c-0de2-4077-9b00-381764a3f067 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.269132 Jan 31 17:11:11.145836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 341/624] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:10 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:11.198411 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2f02c563-3f6d-41fe-828f-abf87723fa00 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.205331 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2f02c563-3f6d-41fe-828f-abf87723fa00 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1219 microversion: 2.1 time: 0.073049 Jan 31 17:11:11.206490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 284/625] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:11 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:11.261024 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:11.262009 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:11.275562 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:11.276345 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.279161 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:11.279805 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.469461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.480329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9170ccb6-9479-4b30-8d4a-55a0439e12de tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1708 microversion: 2.1 time: 0.222359 Jan 31 17:11:11.491609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 342/626] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:11 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1708 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:11.704073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:11.705537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:11.712291 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:11.712983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.713834 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:11.714517 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.834081 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:11.835572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: 4da00b7e-f9a6-4973-a402-aa55e327971b] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:11.850811 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:11.850950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.851989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:11.852599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:11.877613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] HTTP exception thrown: Instance 4da00b7e-f9a6-4973-a402-aa55e327971b could not be found. Jan 31 17:11:11.878441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Returning 404 to user: Instance 4da00b7e-f9a6-4973-a402-aa55e327971b could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:11:11.879434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-37d6017d-3506-4c0f-8064-42ee2fad3d72 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b" status: 404 len: 111 microversion: 2.1 time: 0.049481 Jan 31 17:11:11.880667 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 343/627] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:11 2022] GET /compute/v2.1/servers/4da00b7e-f9a6-4973-a402-aa55e327971b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:11:11.945638 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:11.968061 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8aa17237-f249-429c-8689-b2571adb47cb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.267519 Jan 31 17:11:11.970601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 285/628] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:11 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:12.149104 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:12.150022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:12.162264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.162839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.163716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.164467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:12.165266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:12.166431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.180016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.183523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.184659 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.185562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.666098 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:12.674966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e5b5b826-a497-49c0-9297-84d3196fe73e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.532229 Jan 31 17:11:12.676117 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 344/629] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:12 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:12.688967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:12.689608 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:12.698131 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:12.706662 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:12.708750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:12.709938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9eadfb2f-3fcd-4987-b2b3-815bf89def92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.550634 Jan 31 17:11:12.710175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.710836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 286/630] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:12 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:12.715183 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:12.715794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:12.721245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.721842 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.722301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.722605 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.723066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.723170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.723572 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.823905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:12.844295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ae71a35d-4397-42eb-9349-b91917fd41dc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1271 microversion: 2.1 time: 0.164448 Jan 31 17:11:12.845631 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 345/631] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:12 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:12.924863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:12.934345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bcb6b8f7-f71c-4f72-ac6a-64f088d0b399 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1712 microversion: 2.1 time: 0.222449 Jan 31 17:11:12.934929 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 287/632] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:12 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1712 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:12.985272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:12.985877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:12.995470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.995835 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:12.996664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:12.997406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.048954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:13.049534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:13.056796 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.057606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.058575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.059200 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.086302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:11:13.189418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-74cd3d09-bf92-467f-a45a-0b85d97382a5 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "DELETE /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 204 len: 0 microversion: 2.1 time: 0.142891 Jan 31 17:11:13.190590 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 288/633] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:11:13 2022] DELETE /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 17:11:13.203582 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:13.208155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:13.219236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.220607 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.221423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.221863 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.248210 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:13.260358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1e564d4e-60ab-481c-b146-b4be38f32ffb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.278366 Jan 31 17:11:13.261545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 346/634] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:12 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:13.471239 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:13.488503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-18d075d9-d041-4bb8-a117-dfe8098cfcbc tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1512 microversion: 2.1 time: 0.293112 Jan 31 17:11:13.489155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 289/635] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:13 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:13.693372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:13.693892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:13.700913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.701369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.702165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.702606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.732426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:13.733199 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:13.744763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.745361 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:13.746262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:13.748851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.036169 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.044656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-02a1033a-f9c7-4978-8dfd-d82a7e0578aa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.355516 Jan 31 17:11:14.052138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 347/636] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:13 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:14.056765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:14.060836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:14.079748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:14.080689 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.081574 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:14.082093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.112940 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.147130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.151007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.153734 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8b3e5dc7-efbd-4065-88a0-87b2578a7c47 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.427199 Jan 31 17:11:14.154766 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 290/637] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:13 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:14.277851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:14.278744 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:14.289904 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:14.290583 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.291373 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:14.291803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.442380 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.449975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9f4e9ba7-51a6-4728-ba20-e29a890e4746 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.396667 Jan 31 17:11:14.450741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 348/638] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:14 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:14.508877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:14.509415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:14.519577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:14.522061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.522539 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:14.523116 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:14.577179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.588139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5c205ff8-7be8-4e0a-86c5-d68294739bee tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.314636 Jan 31 17:11:14.588917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 291/639] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:14 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:14.828581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:14.841330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-909bd62e-aba6-4b94-9ca1-38f4c0d86a40 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1512 microversion: 2.1 time: 0.338834 Jan 31 17:11:14.851119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 349/640] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:14 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:15.069501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:15.070096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:15.082364 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.083499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.085054 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.085054 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.172660 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:15.173280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:15.188648 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.189152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.190180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.190806 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.416806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:15.425408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-832d10ed-2407-4acd-a8b3-5bd518527296 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.360197 Jan 31 17:11:15.429369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 292/641] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:15 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:15.436428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-e46c82a9-2a7e-48d7-ab05-6bba7b32dfc5 req-05ad9ab7-49f6-4c8d-9904-2c1d38db4d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecab8643-3faa-4e3e-88f2-8adfcb1c71a0", "tag": "c048fe71-6e09-497a-bf75-3e88dc581cf2"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:15.438269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:15.438269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:15.452391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-e46c82a9-2a7e-48d7-ab05-6bba7b32dfc5 req-05ad9ab7-49f6-4c8d-9904-2c1d38db4d85 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.453196 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-e46c82a9-2a7e-48d7-ab05-6bba7b32dfc5 req-05ad9ab7-49f6-4c8d-9904-2c1d38db4d85 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.469209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-e46c82a9-2a7e-48d7-ab05-6bba7b32dfc5 req-05ad9ab7-49f6-4c8d-9904-2c1d38db4d85 service nova] Creating event network-changed:c048fe71-6e09-497a-bf75-3e88dc581cf2 for instance ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 on hv-cinder-81566 Jan 31 17:11:15.476040 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-e46c82a9-2a7e-48d7-ab05-6bba7b32dfc5 req-05ad9ab7-49f6-4c8d-9904-2c1d38db4d85 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044775 Jan 31 17:11:15.476899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 293/642] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:15.482946 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:15.484507 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:15.492223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.492927 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.493867 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.494474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.515412 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:15.524756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:15.526487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:15.527852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-068b31f1-2f25-4a25-9313-163afcc08f6f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.358859 Jan 31 17:11:15.528606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 350/643] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:15 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:15.605129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:15.606022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:15.613207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.614414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.615388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.616023 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.729857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:15.738327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-200d4507-b0f9-4654-a036-9435507b0fdf tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.259318 Jan 31 17:11:15.740327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 294/644] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:15 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:15.776803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a1a68f52-22d3-4bf9-8864-63cc98de82a9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Action: 'create', calling method: .version_select at 0x7fdce29775e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2006550850"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:15.790198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-a1a68f52-22d3-4bf9-8864-63cc98de82a9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Getting quotas for project 894b01e219924a8abe1a46602ad87782. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:11:15.794048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-a1a68f52-22d3-4bf9-8864-63cc98de82a9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Getting quotas for user 3583e4e66b7644fc8bf78cd2f94bffb9 and project 894b01e219924a8abe1a46602ad87782. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:11:15.871358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:15.880837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f46893dd-e70c-4228-9d3f-00903753d2d6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.278558 Jan 31 17:11:15.881610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 351/645] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:15 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:15.893098 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:15.893716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:15.900782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.901229 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:15.903956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:15.903956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.019657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-a1a68f52-22d3-4bf9-8864-63cc98de82a9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Getting quotas for project 894b01e219924a8abe1a46602ad87782. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:11:16.024785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-a1a68f52-22d3-4bf9-8864-63cc98de82a9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Getting quotas for user 3583e4e66b7644fc8bf78cd2f94bffb9 and project 894b01e219924a8abe1a46602ad87782. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:11:16.039308 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a1a68f52-22d3-4bf9-8864-63cc98de82a9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.265626 Jan 31 17:11:16.039933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 295/646] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Jan 31 17:11:15 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:16.131403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:16.135772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b0dae483-4d92-4570-956c-d8e8fcf9b274 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1512 microversion: 2.1 time: 0.246369 Jan 31 17:11:16.136785 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 352/647] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:15 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:16.140592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1219126141", "imageRef": "77bb0316-b20e-4d70-8524-0ffaf45e1d03", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2006550850", "networks": [{"uuid": "44467c91-2148-4889-a663-1a57fe6eaad9"}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:16.193716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] validate_networks() for [('44467c91-2148-4889-a663-1a57fe6eaad9', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:11:16.445430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:16.446028 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:16.452004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.452661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.453470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.453918 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.761860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:11:16.761860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:11:16.762337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:11:16.762805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:11:16.763212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:11:16.772882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.773327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.774126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.774599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.791023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Getting quotas for project 894b01e219924a8abe1a46602ad87782. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:11:16.795103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Getting quotas for user 3583e4e66b7644fc8bf78cd2f94bffb9 and project 894b01e219924a8abe1a46602ad87782. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:11:16.806524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:11:16.808784 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77bb0316-b20e-4d70-8524-0ffaf45e1d03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:11:16.837356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:16.846084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-33ed767e-a07a-4f74-b6ce-b23493d90982 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.404305 Jan 31 17:11:16.851746 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 353/648] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:16 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:16.852346 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:16.853206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:16.858974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2927e38a-acc4-4d29-beb0-8ba8e156fb70 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725919 Jan 31 17:11:16.859622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 296/649] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:11:16.860897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.861600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.863117 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.863742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.864620 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:16.865850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:16.872750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.873207 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:16.873994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:16.874433 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.555201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.562926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.564486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.565901 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f6294a28-d58a-4024-a3ad-5c7a61d1be65 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1744 microversion: 2.20 time: 0.717935 Jan 31 17:11:17.576015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 354/650] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:16 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1744 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:17.576255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.576737 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:17.576737 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:17.576926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-10c2e634-9bdf-4527-8169-72b0058a4c48 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.715566 Jan 31 17:11:17.582132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.583754 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.584800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.585385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.587866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 297/651] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:16 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:17.594342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:17.595167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:17.603130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.603742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.604732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.605392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.678561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.685956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6454846d-41db-4b73-8516-19b92d11420d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1255 microversion: 2.1 time: 0.118773 Jan 31 17:11:17.686531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 355/652] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:17 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1255 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:17.690756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:17.691362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:17.699308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.699968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.700868 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.701311 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.865622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.873266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7caebd01-d5f0-4644-a135-d19ca9010a0a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.284227 Jan 31 17:11:17.873945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 298/653] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:17 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:17.887178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:17.888194 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:17.894310 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.894762 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.896016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:17.896482 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:17.901690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:17.917721 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-67f6b0d6-716d-4920-9c29-cbb002242bb9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1512 microversion: 2.1 time: 0.230161 Jan 31 17:11:17.918449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 356/654] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:17 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:18.181759 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:18.190920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e161366b-ec92-40f2-a28f-9e569f71006b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.308042 Jan 31 17:11:18.193119 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 299/655] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:17 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:18.233145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-f8c8535e-cfa3-4c55-b45c-03b2c0064e13 req-29f9c6be-a545-4c02-b248-6b7475cd90c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "name": "network-vif-plugged", "status": "completed", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:18.235005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:18.235005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:11:18.242544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f8c8535e-cfa3-4c55-b45c-03b2c0064e13 req-29f9c6be-a545-4c02-b248-6b7475cd90c5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.243241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f8c8535e-cfa3-4c55-b45c-03b2c0064e13 req-29f9c6be-a545-4c02-b248-6b7475cd90c5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.255462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-f8c8535e-cfa3-4c55-b45c-03b2c0064e13 req-29f9c6be-a545-4c02-b248-6b7475cd90c5 service nova] Creating event network-vif-plugged:e7ff3fe5-09f9-4881-8621-ae4162f6a416 for instance 4cada1e7-b97c-481f-bb74-31b3721ef746 on hv-cinder-81566 Jan 31 17:11:18.260913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-f8c8535e-cfa3-4c55-b45c-03b2c0064e13 req-29f9c6be-a545-4c02-b248-6b7475cd90c5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031351 Jan 31 17:11:18.262022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 357/656] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:11:18.586878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:18.588964 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:18.594789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.595249 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.596418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.596628 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:18.597184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.598529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:18.606735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.607461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.608591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.609195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.918717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:18.923729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:18.926486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d28b0044-1a79-4bd7-af13-dbf58d5fdd40 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.335124 Jan 31 17:11:18.927263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 358/657] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:18 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:18.931735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:18.932376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:18.938276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.938773 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.939568 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.940019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.943372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:18.944974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:18.946150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-50220211-2e6a-4c30-91b7-924c5bbd8e80 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1744 microversion: 2.20 time: 0.365848 Jan 31 17:11:18.946726 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 300/658] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:18 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1744 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:18.951170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-16f12fa8-5df5-4c03-a6a6-6138ce05d150 req-51dce4bd-966c-4ef3-9224-0321ee5e25e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b129cbbf-8ef7-494c-ac01-075b087f7cfc", "name": "network-vif-deleted", "tag": "ac265cc5-fbf2-4309-8e14-2ed6a9b2682f"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:18.953347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:18.953347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:18.960915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-16f12fa8-5df5-4c03-a6a6-6138ce05d150 req-51dce4bd-966c-4ef3-9224-0321ee5e25e5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.961365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-16f12fa8-5df5-4c03-a6a6-6138ce05d150 req-51dce4bd-966c-4ef3-9224-0321ee5e25e5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.972038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-16f12fa8-5df5-4c03-a6a6-6138ce05d150 req-51dce4bd-966c-4ef3-9224-0321ee5e25e5 service nova] Creating event network-vif-deleted:ac265cc5-fbf2-4309-8e14-2ed6a9b2682f for instance b129cbbf-8ef7-494c-ac01-075b087f7cfc on hv-cinder-81566 Jan 31 17:11:18.977783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-16f12fa8-5df5-4c03-a6a6-6138ce05d150 req-51dce4bd-966c-4ef3-9224-0321ee5e25e5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029772 Jan 31 17:11:18.978376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 301/659] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:18.983067 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:18.983763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:18.990047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.990499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:18.992012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:18.992484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.005083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:19.012718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-31378891-e33b-4abf-9891-2532e801fc38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1319 microversion: 2.1 time: 0.084326 Jan 31 17:11:19.013299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 359/660] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:18 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1319 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:19.017512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:19.018124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:19.025055 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.025544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.026397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.026871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.096828 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:19.104533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f7f33874-3e4a-4447-a126-c1a45a8a064e tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1470 microversion: 2.1 time: 0.090192 Jan 31 17:11:19.105113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 360/661] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:19 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1470 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:19.158973 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:19.166197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fa4ee064-f18a-43c9-b0fe-408257092da9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.186733 Jan 31 17:11:19.166765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 302/662] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:18 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:19.209817 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:19.210433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:19.216936 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.217394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.218175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.218611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.430730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:19.442125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-009f80c5-2915-4f45-ab94-317b180d8664 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.235690 Jan 31 17:11:19.443634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 361/663] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:19 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:19.942574 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:19.943884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:19.950119 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.950801 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.951760 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.952380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.965262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:19.966079 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:19.979735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.981465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:19.982607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:19.983292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.278565 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:20.286552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5b1e8c24-76e3-46a2-b8d2-23b61921c31f tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.347174 Jan 31 17:11:20.299827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:20.304330 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 303/664] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:19 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:20.312804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:20.314408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:20.315601 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f45c085f-74be-43d9-8c68-017dc9876e93 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1744 microversion: 2.20 time: 0.355323 Jan 31 17:11:20.316164 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 362/665] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:19 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1744 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:20.318795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:20.319801 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:20.334557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:20.335729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:20.338605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.339149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.343066 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.343910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.350426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.351966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.352880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.354723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.420342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.420792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.421244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:20.510171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:20.521892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-911a3918-4857-42a4-82b2-4ee32060ee5c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.199810 Jan 31 17:11:20.522814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 363/666] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:20 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:20.527812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:20.528663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:20.537762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.538813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.540223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.540874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.764147 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:20.777063 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d42db180-da50-47a6-adb7-3aca080f7b86 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.467680 Jan 31 17:11:20.779473 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 304/667] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:20 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:20.793367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-103f8832-7fbd-498f-b96b-b943257a1be1 req-1cfe7f38-f312-4488-a4be-f6e17700bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "name": "network-vif-plugged", "status": "completed", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:20.797481 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:20.797481 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:20.808123 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-103f8832-7fbd-498f-b96b-b943257a1be1 req-1cfe7f38-f312-4488-a4be-f6e17700bfe9 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.809097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-103f8832-7fbd-498f-b96b-b943257a1be1 req-1cfe7f38-f312-4488-a4be-f6e17700bfe9 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.823142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-103f8832-7fbd-498f-b96b-b943257a1be1 req-1cfe7f38-f312-4488-a4be-f6e17700bfe9 service nova] Creating event network-vif-plugged:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:11:20.828844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-103f8832-7fbd-498f-b96b-b943257a1be1 req-1cfe7f38-f312-4488-a4be-f6e17700bfe9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047908 Jan 31 17:11:20.835490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 305/668] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:20.845776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:20.847396 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:20.855744 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.856799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:20.857890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:20.858535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.207130 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.217661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-86dad4cb-ba14-46e0-8af4-eae507ecea4f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.693487 Jan 31 17:11:21.228134 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 364/669] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:20 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:21.323329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:21.324585 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:21.333797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.334327 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.335250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.335586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.342954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.360767 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-eb07027d-3a7e-417b-94d0-3329ffd1b51e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.519128 Jan 31 17:11:21.361849 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 306/670] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:20 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:21.370133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:21.371890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:21.386728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.387455 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.388475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.389236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.697525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.705302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-41080af4-ea89-463d-805f-ae71d9f68b83 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.400144 Jan 31 17:11:21.706106 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 365/671] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:21 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:21.710276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.718906 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.719756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:21.720440 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:21.720568 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.721764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cababb0d-08f8-4303-aeee-9012cf847073 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.358557 Jan 31 17:11:21.722246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 307/672] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:21 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:21.726608 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.727069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.727879 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.728389 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.763322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.763561 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.764042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:21.800746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:21.802009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:21.813485 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.813936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.814749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.815188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.834205 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:21.844604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ff999cef-38ca-420e-9fd9-53be189ef240 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.128577 Jan 31 17:11:21.845449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 366/673] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:21 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:21.850444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-da68ad3d-119e-4aa2-a482-b8dedf9afd0b req-3c017a5e-b103-42b4-89ce-4e962f9a4688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:21.852365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:21.852365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:11:21.859638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-da68ad3d-119e-4aa2-a482-b8dedf9afd0b req-3c017a5e-b103-42b4-89ce-4e962f9a4688 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:21.860092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-da68ad3d-119e-4aa2-a482-b8dedf9afd0b req-3c017a5e-b103-42b4-89ce-4e962f9a4688 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:21.874505 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-da68ad3d-119e-4aa2-a482-b8dedf9afd0b req-3c017a5e-b103-42b4-89ce-4e962f9a4688 service nova] Creating event network-changed:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:11:21.880010 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-da68ad3d-119e-4aa2-a482-b8dedf9afd0b req-3c017a5e-b103-42b4-89ce-4e962f9a4688 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032819 Jan 31 17:11:21.885241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 367/674] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:21.997724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.006487 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-43dd5496-51a2-4a13-88c9-c770320023ff tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.212720 Jan 31 17:11:22.007080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 308/675] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:21 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:22.236024 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:22.236904 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:22.244092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.244574 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.245363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.245796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.381980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:22.382783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:22.388424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.389314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.389833 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.390697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.391212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.396527 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-543458d2-9f8b-4d4f-bf81-2f85859d4de2 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.164944 Jan 31 17:11:22.397105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 368/676] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:22 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:22.534137 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.543614 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-49cbab57-7c03-43df-9147-6f02eadbe616 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.167185 Jan 31 17:11:22.544218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 309/677] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:22 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:22.721371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:22.722148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:22.729479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.730036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.731004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.731588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.745273 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:22.746220 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:22.752650 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.753178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.754035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.754520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.950007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.959078 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.959289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-df93c8ce-e5b4-476f-b9d6-3e4f56ac4ca9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.241317 Jan 31 17:11:22.968080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.969073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 369/678] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:22 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:22.970706 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:22.972136 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-670064ed-4e97-47fd-8974-9be68bc43d78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.231072 Jan 31 17:11:22.974280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:22.974466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 310/679] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:22 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:22.974897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:22.981251 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.981699 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:22.982489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:22.982933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.015615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.016061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.017211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:23.023483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:23.024633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:23.030667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.031126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.031993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.032467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.059593 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:23.068511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-566afa84-a8e0-4587-bcf5-3a1612240fac tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.098268 Jan 31 17:11:23.069189 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 370/680] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:22 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:23.184729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:23.192683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-54b65c41-2e1c-4353-872e-007027d731d4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.173076 Jan 31 17:11:23.193037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 311/681] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:23 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:23.413727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:23.414787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:23.421276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.421731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.422524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.422969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.560202 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:23.560981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:23.567568 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:23.568630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.569136 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.569873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.570310 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.574927 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-16574c77-2bc2-43ff-96af-aa3d132b9b55 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.165496 Jan 31 17:11:23.575502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 371/682] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:23 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:23.711735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:23.719568 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c74852e5-3db5-411b-a5d6-dcd81825f687 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.163025 Jan 31 17:11:23.720165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 312/683] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:23 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:23.979366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:23.980383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:23.990461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.990848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:23.991093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:23.991497 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:23.992073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:23.992612 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.000870 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.001332 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.002141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.002596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.228522 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.237018 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.239501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.240987 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c55fcf14-d7b2-443d-b0eb-b69b44d3cac1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.254559 Jan 31 17:11:24.242120 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 313/684] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:23 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:24.246451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:24.247573 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:24.254274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.254902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.255792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.256252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.261796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.269305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-89bf2a20-f897-43a0-91dc-2e4e5988580d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.297011 Jan 31 17:11:24.274971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 372/685] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:23 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:24.275929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-a34c9691-b1bc-49c4-8cd3-3204fe6ff844 req-9d66281c-8ba1-4fcf-8723-cee1e2ddcd8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecab8643-3faa-4e3e-88f2-8adfcb1c71a0", "name": "network-vif-plugged", "status": "completed", "tag": "c048fe71-6e09-497a-bf75-3e88dc581cf2"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:24.277014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:24.277014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:11:24.284012 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a34c9691-b1bc-49c4-8cd3-3204fe6ff844 req-9d66281c-8ba1-4fcf-8723-cee1e2ddcd8b service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.284506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a34c9691-b1bc-49c4-8cd3-3204fe6ff844 req-9d66281c-8ba1-4fcf-8723-cee1e2ddcd8b service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.296604 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.296831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-a34c9691-b1bc-49c4-8cd3-3204fe6ff844 req-9d66281c-8ba1-4fcf-8723-cee1e2ddcd8b service nova] Creating event network-vif-plugged:c048fe71-6e09-497a-bf75-3e88dc581cf2 for instance ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 on hv-cinder-81566 Jan 31 17:11:24.297844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.298533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:24.302821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-a34c9691-b1bc-49c4-8cd3-3204fe6ff844 req-9d66281c-8ba1-4fcf-8723-cee1e2ddcd8b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030913 Jan 31 17:11:24.303958 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 373/686] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:24.308800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:24.309540 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:24.315985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.316480 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.318385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.318838 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.358949 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.367295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4ee2a7ce-8536-43cb-b851-9e190970f5a1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.124011 Jan 31 17:11:24.377821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 314/687] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:24 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:24.477842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.485323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-094d75c5-b3a6-449b-88b9-fc1726a070ba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.180590 Jan 31 17:11:24.485890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 374/688] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:24 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:24.593268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:24.593875 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:24.600397 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.600857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.601635 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.602079 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.740078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:24.740728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:24.742572 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.749520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.749981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.750301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a347bfae-ddb0-458d-8cc9-34901e7ec62d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.160943 Jan 31 17:11:24.750782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:24.750879 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 315/689] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:24 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:24.751274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:24.891039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:24.900387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-dec4a2d2-f3c8-4f01-88db-4c1f62f2bcf8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.166245 Jan 31 17:11:24.901516 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 375/690] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:24 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:25.260526 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:25.261129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:25.267055 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.267523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.268337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.268782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.287569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:25.288229 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:25.296407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.296860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.297645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.298083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.499739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.508097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.508419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.509603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.510812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6833a6e4-6a68-4042-bdc1-15a9c2329382 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.253969 Jan 31 17:11:25.515997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ddde109a-cb72-49d5-927c-642867f372ad tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.233052 Jan 31 17:11:25.527080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 376/691] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:25 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:25.528888 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 316/692] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:25 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:25.532396 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:25.533133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:25.533462 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:25.534073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:25.540096 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.540580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.540723 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.541174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.541378 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.541820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.541955 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.542392 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.586685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.587129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.587591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:25.643888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.652530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-157a95b5-e681-4395-ac03-4dc5d28fad05 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.123929 Jan 31 17:11:25.653107 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 377/693] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:25 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:25.727544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.734823 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7622e241-7f3f-4a37-bd4b-b64f440a24da tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.204894 Jan 31 17:11:25.735417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 317/694] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:25 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:25.766641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:25.767338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:25.775514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.776019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.776798 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.777254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.917189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:25.917814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:25.918939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:25.924065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.924560 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:25.925366 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:25.929949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a8f82624-2ae3-45a0-afd2-6203eb123070 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.166910 Jan 31 17:11:25.930654 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 378/695] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:25 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:25.935242 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.076018 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:26.086050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b3573dc6-8426-47b6-9614-edf57fbb3c09 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.172404 Jan 31 17:11:26.086831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 318/696] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:25 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:26.534730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:26.535381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:26.536597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:26.537447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:26.544862 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.545615 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.546506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.547040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.547921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.548258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.548545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.548909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.797625 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:26.805215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6a6ae381-3273-47a7-8dd9-e6ac52e1c3cc tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.274055 Jan 31 17:11:26.805793 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 379/697] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:26 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:26.815015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:26.815015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:26.825273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.825865 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.826807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.827318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.836903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:26.844690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:26.846493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:26.847735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-321902f1-d699-4650-8436-4e7922417d34 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.316514 Jan 31 17:11:26.848533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 319/698] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:26 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:26.853082 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:26.853902 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:26.860745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.861509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.862668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.863401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.886727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.888321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.888866 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:26.965811 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:26.974723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8a65968e-c161-4d0c-9381-2ce3ac25916c tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.167862 Jan 31 17:11:26.975782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 380/699] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:26 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:26.980068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:26.980839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:26.986911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.987414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:26.988779 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:26.989419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:27.087905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:27.095274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e530cd76-0c8b-4767-acb7-6f1067298dac tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.245610 Jan 31 17:11:27.095845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 320/700] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:26 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:27.102516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:27.103307 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:27.110113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:27.111671 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:27.111671 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:27.112221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:27.194832 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:27.203822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a6c130f6-5012-43b7-a151-93b50c57fed7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.226392 Jan 31 17:11:27.204800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 381/701] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:26 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:27.271995 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:27.281276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c6c6576c-ccf2-40cf-85dd-d2974654fbd1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.182174 Jan 31 17:11:27.282203 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 321/702] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:27 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:27.824772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:27.825218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:27.831853 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:27.832460 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:27.833261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:27.833730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:27.867163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:27.867853 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:27.874722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:27.875428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:27.876491 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:27.877125 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.071498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.078664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.079216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b5687f6e-0971-410b-a9ec-989ab2f5ba9d tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.258818 Jan 31 17:11:28.087614 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.089387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 382/703] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:27 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:28.090108 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.091478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a788cc3f-42f0-41d7-b005-6749dc42bfee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.228929 Jan 31 17:11:28.092236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 322/704] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:27 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:28.093969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:28.094587 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:28.101938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.102395 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.103193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.103991 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.112308 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:28.112923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:28.119966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.120468 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.121262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.121704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.135678 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.136147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.136602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:28.185216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.200632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d095b232-a7d6-4595-be78-f1517f63c9e3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.110037 Jan 31 17:11:28.201214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 383/705] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:28 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:28.220940 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:28.221588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:28.227938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.228492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.229201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.229641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.311007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.320737 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bf547150-1447-4476-9959-ddb3ebc6927e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.212194 Jan 31 17:11:28.321327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 323/706] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:28 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:28.335684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:28.336323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:28.342566 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.343023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.344141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:28.344715 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:28.406388 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.415484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b8fba888-7745-43be-beb9-be31b20221ba tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.198438 Jan 31 17:11:28.416076 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 384/707] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:28 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:28.505603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:28.514054 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d9d3a101-f18c-455c-b343-9d0d4db5d887 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.183070 Jan 31 17:11:28.514898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 324/708] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:28 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:29.096547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:29.097250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:29.104564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.105014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.105914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.106493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.111667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:29.112738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:29.120891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.121496 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.122981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.123827 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.335822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.356479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.357571 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a2d574ac-4cc1-446b-a93c-2a7062c05cce tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.265003 Jan 31 17:11:29.359700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 385/709] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:29 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:29.364467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:29.365217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:29.365539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.372541 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.372850 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.373339 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.373909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-38fc9700-c356-4310-8035-79e7e8c2f9f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.266504 Jan 31 17:11:29.374139 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.374857 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.374973 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 325/710] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:29 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:29.379761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:29.381202 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:29.393959 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.395395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.396850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.397687 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.422198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.422892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.423464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:29.490279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.498437 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-507d0765-2fff-4d0c-b4fe-e44a1d5b42f1 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.139214 Jan 31 17:11:29.499035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 386/711] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:29 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:29.503464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:29.504261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:29.511300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.511741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.513540 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.513990 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.608860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.617672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-58e09952-9fd4-48de-9f0e-2bc7f603f7a8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.241866 Jan 31 17:11:29.620156 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 326/712] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:29 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:29.627987 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:29.629481 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:29.636626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.637086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.637890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:29.638365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:29.731040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.741768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c418477d-b7d2-490c-acea-2f6f5b70f19c tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.241674 Jan 31 17:11:29.742594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 387/713] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:29 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:29.818240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:29.832029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5b47f1db-5ddf-4ccf-81a0-582e68dc8bfa tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.212462 Jan 31 17:11:29.836274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 327/714] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:29 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:30.377104 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:30.377865 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:30.385145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.387339 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.388389 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.388854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.400059 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:30.401163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:30.407599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.408083 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.408938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.409424 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.591657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.599938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6bf18c19-9e8f-4157-b06a-bc801619712a tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.226504 Jan 31 17:11:30.600583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 388/715] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:30 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:30.604828 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:30.605431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:30.611124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.611595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.612649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.613042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.615770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.626753 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.629913 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.629913 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dae12bc3-f775-4ecc-af96-f1cf79caf154 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.241019 Jan 31 17:11:30.631597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 328/716] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:30 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:30.636269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:30.636896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:30.644151 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.644803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.645740 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.646193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.658407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.658872 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.659329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:30.728903 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.736525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a2b98fab-a3f7-4c2a-bcb9-f2bea314ccd9 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.134874 Jan 31 17:11:30.745728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 389/717] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:30 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:30.761350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:30.762041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:30.769276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.772542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.773512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.774268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.833535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.847530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fb1aae62-88bc-4dbb-b83f-76959dbadce5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.214618 Jan 31 17:11:30.850139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 329/718] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:30 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:30.862529 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:30.863228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:30.871778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.872521 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.873354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:30.873799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:30.964926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:30.975602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4eae9c5f-b54a-458c-86e1-228c765c7a84 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.218364 Jan 31 17:11:30.976211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 390/719] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:30 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:31.049212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:31.057321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a609d306-5674-49c0-8221-8df33ed05c10 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.206093 Jan 31 17:11:31.057898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 330/720] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:30 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:31.617466 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:31.618073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:31.624639 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.625100 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.626017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.626487 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.652252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:31.652860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:31.658702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.659158 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.659981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.660516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.815336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:31.823603 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-618c8757-1346-4ce3-aa72-51e18a359298 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.210269 Jan 31 17:11:31.824634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 391/721] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:31 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:31.836976 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:31.837659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:31.842943 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:31.843558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.844017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.844864 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.845488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.851875 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:31.853493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:31.854771 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0ae8ef42-1d54-4642-b921-53e00f530ccf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.206193 Jan 31 17:11:31.855426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 331/722] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:31 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:31.870880 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:31.871497 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:31.877549 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.878009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.879116 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.879236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:31.879559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.879670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:31.880029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lazy-loading 'fault' on Instance uuid b129cbbf-8ef7-494c-ac01-075b087f7cfc {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:31.920341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7d72db9dcc44391af4b1703b0e4377a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa89d77163de421b8159c0095f47b6d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:31.928488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9aae8209-b1f1-4a9b-9852-f2f5d3d2a7f3 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 200 len: 1307 microversion: 2.1 time: 0.102804 Jan 31 17:11:31.929070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 392/723] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:31 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:31.993256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:31.993791 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:31.999884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.000385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.001180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.001629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.018109 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:32.026082 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b2e0a0c2-4bc0-412d-af76-2d60bc334626 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.158576 Jan 31 17:11:32.026668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 332/724] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:31 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:32.075050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:32.075688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:32.081670 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.082221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.083127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.083596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.166848 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:32.179526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-29ec9027-8e45-491d-9efe-269ce63fd416 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.191012 Jan 31 17:11:32.188663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 393/725] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:31 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:32.260258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:32.267885 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8dbafb88-84e7-4659-a502-d4da7d763c14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1567 microversion: 2.1 time: 0.196937 Jan 31 17:11:32.268476 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 333/726] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:32 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:32.842337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:32.842944 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:32.860535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.861842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.862822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.864390 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.874867 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:32.875790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:32.897126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.898778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:32.900519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:32.901553 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.197269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:33.210162 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:33.215273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3e69256e-431b-41fa-9899-034db9a6b6c8 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.377713 Jan 31 17:11:33.219859 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:33.221385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:33.222900 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e425690e-c04a-4bbc-af7b-de755306acb2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.352891 Jan 31 17:11:33.223722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 334/727] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:32 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:33.229192 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:33.229363 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 394/728] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:32 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:33.229452 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] [instance: b129cbbf-8ef7-494c-ac01-075b087f7cfc] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:33.235206 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.235658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.236472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.236910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.245230 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:33.246589 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:33.252956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.254294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.254493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] HTTP exception thrown: Instance b129cbbf-8ef7-494c-ac01-075b087f7cfc could not be found. Jan 31 17:11:33.255294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] Returning 404 to user: Instance b129cbbf-8ef7-494c-ac01-075b087f7cfc could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:11:33.255757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.256358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.256530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-10f6f504-d9d5-4a4d-82e0-250be7ae4a73 tempest-AttachVolumeNegativeTest-1932709737 tempest-AttachVolumeNegativeTest-1932709737-project] 10.222.0.91 "GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc" status: 404 len: 111 microversion: 2.1 time: 0.031765 Jan 31 17:11:33.257541 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 335/729] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:33 2022] GET /compute/v2.1/servers/b129cbbf-8ef7-494c-ac01-075b087f7cfc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:11:33.266131 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:33.267014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:33.275073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.275523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.276648 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.276818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.569310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:33.578804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0be65f2d-f82a-4dd5-8191-62bce2959ded tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.347425 Jan 31 17:11:33.579411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 395/730] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:33 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:33.580793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:33.584507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:33.585118 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:33.591324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.591803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.592619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:33.593064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:33.599948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5f906401-041c-45e3-ad7d-8bf6b6cf39f3 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1259 microversion: 2.1 time: 0.337770 Jan 31 17:11:33.615056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 336/731] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:33 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1259 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:33.989262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:34.004127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6bb8e337-96e2-43d8-a107-dde59a27666a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1547 microversion: 2.1 time: 0.423170 Jan 31 17:11:34.004935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 396/732] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:33 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1547 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:34.022377 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:34.023410 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:34.037533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.038218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.039292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.039918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.202661 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] HTTP exception thrown: Cannot 'detach_volume' instance 1ee59a59-7ed3-4b35-8a54-a257556f657c while it is in vm_state rescued Jan 31 17:11:34.203525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Returning 409 to user: Cannot 'detach_volume' instance 1ee59a59-7ed3-4b35-8a54-a257556f657c while it is in vm_state rescued {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:11:34.204632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-68ef26bf-f54f-4202-9d6f-bb8806eece5d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments/b3584678-1969-42f9-9cb7-f893123e8972" status: 409 len: 152 microversion: 2.1 time: 0.187514 Jan 31 17:11:34.205593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 337/733] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:11:34 2022] DELETE /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments/b3584678-1969-42f9-9cb7-f893123e8972 => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 31 17:11:34.214803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:34.215620 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:34.221872 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.223391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.224837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.225695 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.247415 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:34.248036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:34.262279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.262784 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.263598 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.264041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.363658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5e5c29ea-3f8f-4385-a5e2-284248037058 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action" status: 202 len: 0 microversion: 2.1 time: 0.152758 Jan 31 17:11:34.365027 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 397/734] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:11:34 2022] POST /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:11:34.370317 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:34.371244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:34.379324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.380314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.381359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.382035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.871436 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:34.881960 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:34.887142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:34.898301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c40a6949-4982-40d9-a457-d2ef0f39690e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.655329 Jan 31 17:11:34.899394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 338/735] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:34 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:34.904069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:34.904807 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:34.921529 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.924565 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:34.925709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:34.936818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.062950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:35.075063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e8aa3bde-021d-4aab-9523-69eb60810b2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1319 microversion: 2.1 time: 0.705254 Jan 31 17:11:35.079092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 398/736] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:34 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:35.088417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:35.089338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:35.099012 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.100830 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.102522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.103638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.379278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:35.405661 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-31631f3b-6b59-4cd5-bed8-c8778690a8fe tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1555 microversion: 2.1 time: 0.505006 Jan 31 17:11:35.414628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 339/737] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:34 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1555 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:35.424430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:35.433468 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:35.451429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.455087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.456216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.459727 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.502224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:35.511878 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6f9f9375-3d16-4b22-8a7f-3c11735d8f85 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.431537 Jan 31 17:11:35.513049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 399/738] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:35 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:35.683331 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:35.694236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-22725a80-c2a8-49a1-8954-6292e82853eb tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1442 microversion: 2.1 time: 0.278421 Jan 31 17:11:35.695378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 340/739] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:35 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1442 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:35.711086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:35.711761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:35.719889 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.720379 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.721194 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.721645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.917292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:35.918816 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:35.931189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.932167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.933963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:35.934637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:35.954715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:35.973347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8e1d3689-261d-434d-b4eb-6324ada3fe0b tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1442 microversion: 2.1 time: 0.265913 Jan 31 17:11:35.984206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 400/740] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:35 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1442 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:36.095673 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:36.096901 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:36.110873 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:36.111727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:36.116206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:36.120538 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:36.152886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:36.169587 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:36.172121 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:36.173860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-333e58ef-020d-4374-8d48-283017d5b91b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.260246 Jan 31 17:11:36.185009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 341/741] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:35 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:36.400474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:36.432628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:36.433271 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:36.442415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e31324a6-8a3c-4490-91fa-a31429c52a1e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1507 microversion: 2.1 time: 0.350823 Jan 31 17:11:36.443322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 401/742] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:36 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:36.452174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:36.469106 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:36.470821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:36.475947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:36.529506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:36.531368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:36.547573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:36.548718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:36.549774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:36.550499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:36.873066 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:36.887316 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b9a0265e-7b1f-44fe-bea0-307b3ab575d8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1555 microversion: 2.1 time: 0.460003 Jan 31 17:11:36.890035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 342/743] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:36 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1555 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:36.901226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:36.909578 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3800f48b-9caf-4a78-8d94-f967a0d9f8ee tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.383854 Jan 31 17:11:36.911842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 402/744] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:36 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:37.196430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:37.197695 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:37.205409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:37.206218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:37.207402 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:37.208063 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:37.590761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:37.606047 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:37.607812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:37.609385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7770c5af-fbf6-4034-92bf-a927e55f3ee8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.419599 Jan 31 17:11:37.610021 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 343/745] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:37 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:37.907925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:37.907925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:37.919200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:37.919650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:37.928972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:37.929594 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:37.934510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:37.934971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:37.938450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:37.940049 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:37.941222 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:37.941805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:38.512640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:38.520288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-841b9192-5efa-4270-80a8-629563cfcfbc tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.595712 Jan 31 17:11:38.523847 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 344/746] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:37 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:38.533125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:38.543178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d599e88d-bf02-4470-b0be-35d39ff03c20 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1555 microversion: 2.1 time: 0.640216 Jan 31 17:11:38.544022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 403/747] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:37 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1555 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:38.628895 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:38.630610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:38.638544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:38.640066 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:38.642891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:38.644959 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:38.995959 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:39.009963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:39.011478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:39.012732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0b455079-2359-4f99-94c7-2abc28528113 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.388040 Jan 31 17:11:39.013301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 345/748] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:38 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:39.476374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-8da90502-2b86-4916-a596-2c843b3a34f1 req-c595116e-4b20-48e8-a359-87a2f18f0e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:39.476374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:39.476374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:11:39.488328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-8da90502-2b86-4916-a596-2c843b3a34f1 req-c595116e-4b20-48e8-a359-87a2f18f0e49 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:39.491837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-8da90502-2b86-4916-a596-2c843b3a34f1 req-c595116e-4b20-48e8-a359-87a2f18f0e49 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:39.523167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-8da90502-2b86-4916-a596-2c843b3a34f1 req-c595116e-4b20-48e8-a359-87a2f18f0e49 service nova] Creating event network-changed:e7ff3fe5-09f9-4881-8621-ae4162f6a416 for instance 4cada1e7-b97c-481f-bb74-31b3721ef746 on hv-cinder-81566 Jan 31 17:11:39.535614 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-8da90502-2b86-4916-a596-2c843b3a34f1 req-c595116e-4b20-48e8-a359-87a2f18f0e49 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065505 Jan 31 17:11:39.535907 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 404/749] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:39.541357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:39.541980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:39.551142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:39.551608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:39.552472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:39.552926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:39.561687 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:39.562390 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:39.574003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:39.574465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:39.575279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:39.575728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:40.003893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:40.008031 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:40.014441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bfa87278-fbe9-4fcd-8da1-feb6a5ce27da tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1555 microversion: 2.1 time: 0.456664 Jan 31 17:11:40.016454 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2a8d563c-79b6-4db0-be89-feb1277771a4 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.479207 Jan 31 17:11:40.016964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 405/750] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:39 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1555 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:40.019642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 346/751] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:39 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:40.035149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:40.036272 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:40.051607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:40.053677 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:40.056915 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:40.057544 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:40.358240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:40.374994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:40.379067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:40.380751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7491ca7b-7aed-4a8a-8ab0-66ae960ff289 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.353980 Jan 31 17:11:40.381690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 406/752] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:40 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:41.033526 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:41.034132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:41.036190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:41.037120 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:41.042590 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.043724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.044256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.045390 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.045990 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.049177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.050901 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.053557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.373271 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:41.375995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:41.385674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-196f620f-0b5e-48d2-bdb6-490092a2a13b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.353862 Jan 31 17:11:41.387483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e60e7a78-31be-46c8-9ad1-3e102ebac9a9 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1561 microversion: 2.1 time: 0.357276 Jan 31 17:11:41.397520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 407/753] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:41 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:41.401510 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 347/754] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:41 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1561 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:41.417917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:41.418602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:41.433077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.433413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.436432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.436956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.521616 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:41.522349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:41.544264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.545097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.546359 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.547178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.725796 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lazy-loading 'services' on Instance uuid 1ee59a59-7ed3-4b35-8a54-a257556f657c {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:11:41.775911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:41.784696 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:41.786201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:41.787376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5327999d-c2d2-4bbb-a50a-6948ab548140 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.388519 Jan 31 17:11:41.788255 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 408/755] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:41 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:41.884961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ce0e6171-3c16-459d-a5c5-abeb1dc12fd5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments/b3584678-1969-42f9-9cb7-f893123e8972" status: 202 len: 0 microversion: 2.1 time: 0.377240 Jan 31 17:11:41.885864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 348/756] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:11:41 2022] DELETE /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments/b3584678-1969-42f9-9cb7-f893123e8972 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:11:41.894459 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:41.895576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:41.902334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.903644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.905284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:41.905977 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:41.968095 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-93146db4-af10-46b9-b9de-04afd5f639c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077742 Jan 31 17:11:41.969039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 409/757] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:11:41 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:42.239554 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-3b05a357-c2b9-4bbd-89ad-6d42f3ba49d9 req-4146ccc2-bfc7-49ab-a16a-4e1a184ea28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "name": "network-vif-plugged", "status": "completed", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:42.241782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:42.241782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:42.250925 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-3b05a357-c2b9-4bbd-89ad-6d42f3ba49d9 req-4146ccc2-bfc7-49ab-a16a-4e1a184ea28f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:42.251295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-3b05a357-c2b9-4bbd-89ad-6d42f3ba49d9 req-4146ccc2-bfc7-49ab-a16a-4e1a184ea28f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:42.286180 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-3b05a357-c2b9-4bbd-89ad-6d42f3ba49d9 req-4146ccc2-bfc7-49ab-a16a-4e1a184ea28f service nova] Creating event network-vif-plugged:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:11:42.294494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-3b05a357-c2b9-4bbd-89ad-6d42f3ba49d9 req-4146ccc2-bfc7-49ab-a16a-4e1a184ea28f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059472 Jan 31 17:11:42.296756 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 349/758] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:42.405752 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:42.406599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:42.417285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:42.417760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:42.419560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:42.420415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:42.812674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:42.814283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:42.826572 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:42.831942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:42.835423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:42.835959 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:42.883765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:42.894834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d92c8c14-b110-4f4a-b258-d7c072b0a6b8 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.495578 Jan 31 17:11:42.896336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 410/759] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:42 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:42.980619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:42.981790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:42.999358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:42.999819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:43.006575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:43.007287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:43.047734 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a4eadf96-c6ab-4d0b-ac8a-7cd7a390c259 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071180 Jan 31 17:11:43.048722 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 411/760] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:11:42 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:11:43.050747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:43.059302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:43.060848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:43.061991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a62ece3b-175e-4219-9d57-eda68c1a9df7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.253499 Jan 31 17:11:43.072425 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 350/761] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:42 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:43.911799 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:43.912568 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:43.919088 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:43.919771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:43.920934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:43.921535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:44.061901 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:44.062989 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:44.092293 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:44.093326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:44.094455 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:44.097195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:44.110685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:44.119877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e3f03026-2308-4977-9429-0ad026834c4c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.212502 Jan 31 17:11:44.122258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 412/762] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:43 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:44.127224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:44.128258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:44.137308 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c7ea0694-982f-483a-846f-8e7d609bb460 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079505 Jan 31 17:11:44.141112 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 351/763] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:11:44 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:11:44.142092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:44.142750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:44.143574 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:44.144944 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:44.306550 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:44.340326 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:44.342290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:44.343851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2d8c54d0-728e-4199-a50d-c5507b3ec0ff tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.220436 Jan 31 17:11:44.345979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 413/764] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:44 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:45.138746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:45.139357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:45.147443 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:45.148253 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:45.149086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:45.149998 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:45.150732 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:45.150957 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:45.158131 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:45.159080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:45.160743 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:45.161442 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:45.198462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-46886aad-364a-405d-a720-9fc8d662f975 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053791 Jan 31 17:11:45.216138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 414/765] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:11:45 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:11:45.364768 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:45.373945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bb822993-0725-488f-9e96-303f1a5d5a14 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1359 microversion: 2.1 time: 0.238469 Jan 31 17:11:45.374846 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 352/766] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:45 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:45.384951 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:45.384951 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:45.387988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:45.388820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:45.390666 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:45.390996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:45.553064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:45.561332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:45.575428 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:45.576843 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d28c1fc5-5b69-4f91-9f31-f7eab8910832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1739 microversion: 2.20 time: 0.203945 Jan 31 17:11:45.577920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 415/767] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:45 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:46.391682 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:46.392326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:46.399186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.399645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.400466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.400910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.541644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:46.548927 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e8003668-f29f-4d8b-9b5a-9baea1b229b6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1548 microversion: 2.1 time: 0.160910 Jan 31 17:11:46.549501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 353/768] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:46 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:46.565135 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:46.566834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:46.573378 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.573777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.574569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.575011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.596640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:46.597922 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:46.603540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.604087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.604981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.605495 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.779079 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:46.788498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b776c5a6-7ef7-4478-a509-dd219e0f9a5b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1548 microversion: 2.1 time: 0.226871 Jan 31 17:11:46.789109 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 416/769] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:46 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:46.803287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:46.807794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:46.811523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:46.811523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:11:46.812579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:46.812718 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:46.813550 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Searching by: {'deleted': False, 'project_id': '894b01e219924a8abe1a46602ad87782'} {{(pid=116483) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 31 17:11:46.814518 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:46.816034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7e8de8cb-4f73-42ba-9b35-8c783f564c68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1721 microversion: 2.20 time: 0.223077 Jan 31 17:11:46.816800 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 354/770] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:46 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:46.820907 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.821362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.822167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:46.822605 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:46.916913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.multi_cell_list [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116483) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 31 17:11:47.019548 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bbc07d32-c59b-4f9c-a574-090575842b73 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215063 Jan 31 17:11:47.020190 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 417/771] 10.222.0.91 () {58 vars in 1124 bytes} [Mon Jan 31 17:11:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:11:47.030240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:47.030999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:47.037509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:47.037969 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:47.038771 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:47.039219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:47.178045 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:47.185769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-578813e9-8d68-41a7-b5e2-0493a2d07793 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1548 microversion: 2.1 time: 0.159252 Jan 31 17:11:47.186406 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 355/772] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:47 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:47.836848 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:47.837539 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:47.843655 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:47.844537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:47.845846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:47.846291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:47.982540 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:47.992230 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:47.995553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:47.997121 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-77bc205c-bc3b-4907-8fd3-2c73b596a51e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1721 microversion: 2.20 time: 0.163680 Jan 31 17:11:48.007378 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 418/773] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:47 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:48.705104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1dac58f-19e1-4666-9066-1c2a439b9131"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:48.713256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:48.724011 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:48.729579 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:48.730497 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:48.731008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.017072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:49.017805 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:49.024435 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:49.024898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.025698 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:49.027403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.062607 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cdb63128-3bf0-4d60-bbab-ac20ff442f7d tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361198 Jan 31 17:11:49.063636 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 356/774] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:11:48 2022] POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:11:49.192957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:49.202545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:49.204054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:49.205238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d48acd09-0aed-4c22-bb48-2d686b4d4c2c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1721 microversion: 2.20 time: 0.192727 Jan 31 17:11:49.205821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 419/775] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:49 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:49.708516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:49.709097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:49.715065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:49.715521 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.716329 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:49.716765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.742787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:11:49.825431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-337a80c0-1710-4852-aff4-1f0086601340 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 204 len: 0 microversion: 2.1 time: 0.121396 Jan 31 17:11:49.826022 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 357/776] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:11:49 2022] DELETE /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:11:49.836350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:49.836862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:49.843020 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:49.843778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.845299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:49.845299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:49.980888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:49.989239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c05663f3-d6fd-48c7-adef-142dafe79028 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1508 microversion: 2.1 time: 0.158226 Jan 31 17:11:49.989750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 420/777] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:49 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:50.228132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-683fd8b0-d209-4d7c-b467-38ad615e0ef9 req-72ed8852-2707-4cfc-a970-f6af9cce4b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "name": "network-vif-unplugged", "status": "completed", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:50.230132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:50.230132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:11:50.231372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:50.232227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:50.240831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-683fd8b0-d209-4d7c-b467-38ad615e0ef9 req-72ed8852-2707-4cfc-a970-f6af9cce4b8c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:50.241285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-683fd8b0-d209-4d7c-b467-38ad615e0ef9 req-72ed8852-2707-4cfc-a970-f6af9cce4b8c service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:50.243008 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:50.244058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:50.245054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:50.245676 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:50.255290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-683fd8b0-d209-4d7c-b467-38ad615e0ef9 req-72ed8852-2707-4cfc-a970-f6af9cce4b8c service nova] Creating event network-vif-unplugged:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:11:50.261737 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-683fd8b0-d209-4d7c-b467-38ad615e0ef9 req-72ed8852-2707-4cfc-a970-f6af9cce4b8c service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041531 Jan 31 17:11:50.262932 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 358/778] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:50.413880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:50.421960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:50.424171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:50.426034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fb68dd3f-c0b9-4322-be2d-dd3f36ba5e37 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1721 microversion: 2.20 time: 0.204677 Jan 31 17:11:50.426669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 421/779] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:50 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:51.006973 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:51.007788 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:51.014262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:51.014714 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:51.015493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:51.015929 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:51.170312 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:51.183877 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bcab7fb7-02ea-4a8c-9026-c5fedd9d52d5 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1508 microversion: 2.1 time: 0.181702 Jan 31 17:11:51.184898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 359/780] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:51 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:51.445180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:51.445796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:51.452030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:51.452515 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:51.453517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:51.453955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:51.641474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:51.650224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:51.651742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:51.652935 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-44a7ec80-0c6a-4128-bb5c-f43f4f3af326 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1724 microversion: 2.20 time: 0.212341 Jan 31 17:11:51.653545 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 422/781] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:51 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:51.672720 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c10719a-322d-4a42-84e4-62407fd13d06"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:51.674014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:51.680193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:51.680821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:51.681602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:51.682037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:51.977480 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4a3ce7a1-7103-44ca-94c7-748fe0824ba3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308612 Jan 31 17:11:51.978099 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 360/782] 10.222.0.91 () {62 vars in 1363 bytes} [Mon Jan 31 17:11:51 2022] POST /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 31 17:11:52.092468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:52.093038 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:52.099102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:52.099415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:52.100225 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:52.100664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:52.195341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bc81aa36-b9cf-4e99-9068-0e44bb98832b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/action" status: 202 len: 0 microversion: 2.20 time: 0.106579 Jan 31 17:11:52.196274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 423/783] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Jan 31 17:11:52 2022] POST /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:11:52.205790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:52.207177 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:52.208573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:52.209259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:52.215928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:52.216518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:52.217270 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:52.217663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:52.218168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:52.218915 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:52.220673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:52.221320 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:52.508316 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:52.518735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:52.521924 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:52.523751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2627c55e-db78-4a07-8348-4977c4c1d674 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1810 microversion: 2.20 time: 0.323188 Jan 31 17:11:52.524523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 361/784] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:52 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1810 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:52.529868 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:52.539424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-57e3fb08-074b-43b4-ac11-dd00d652be3e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1508 microversion: 2.1 time: 0.334785 Jan 31 17:11:52.540593 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 424/785] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:52 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:53.543905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:53.543905 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:53.549784 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:53.550427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:53.551433 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:53.551877 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:53.556417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:53.557620 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:53.564142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:53.564669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:53.566303 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:53.566951 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:53.780616 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:53.786185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:53.790384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:53.791862 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:53.793474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-419dcc98-865e-4eb0-9855-c464078c61c9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.254485 Jan 31 17:11:53.794109 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bb0edb86-ed3c-482c-8c5c-1894c1ff417e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1508 microversion: 2.1 time: 0.241312 Jan 31 17:11:53.794427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 362/786] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:53 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:53.796257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 425/787] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:53 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:54.811619 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:54.812163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:54.812694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:54.813301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:54.819896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:54.820140 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:54.820371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:54.820581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:54.821166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:54.821358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:54.821602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:54.821796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:55.021375 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:55.028140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:55.029603 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:55.031112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:55.032306 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e377f494-4b9b-4b6f-8922-a607c3b8d631 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.223229 Jan 31 17:11:55.032877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 426/788] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:54 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:55.036353 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e3b39cb1-ad79-40f3-a20c-fc251d6bcdfb tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1508 microversion: 2.1 time: 0.228546 Jan 31 17:11:55.037034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 363/789] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:54 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:56.050428 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:56.051188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:56.053141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:56.053786 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:56.058463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:56.058463 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:56.060094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:56.060094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:56.060667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:56.061165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:56.062414 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:56.062664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:56.287926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:56.304083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:56.306294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:56.307466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:56.307709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4f887caa-57ae-4772-9d59-c8ac637aa33a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.261119 Jan 31 17:11:56.308448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 427/790] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:56 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:56.320615 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2b7e1ed2-56bf-4f0f-bb3f-2a0dc641d062 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1508 microversion: 2.1 time: 0.271322 Jan 31 17:11:56.321506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 364/791] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:56 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:56.734975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-15f6ee74-0141-4b6d-8e29-6df92170e3af req-3f38e724-0623-4585-b49e-7bb6e3bbf252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd43f047-fa56-444b-8a9b-7d654a7c2ffa", "name": "network-vif-deleted", "tag": "8434aa23-793d-4765-94c2-651d579a7981"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:11:56.736552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:11:56.736552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:11:56.744067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-15f6ee74-0141-4b6d-8e29-6df92170e3af req-3f38e724-0623-4585-b49e-7bb6e3bbf252 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:56.744534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-15f6ee74-0141-4b6d-8e29-6df92170e3af req-3f38e724-0623-4585-b49e-7bb6e3bbf252 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:56.914360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-15f6ee74-0141-4b6d-8e29-6df92170e3af req-3f38e724-0623-4585-b49e-7bb6e3bbf252 service nova] Creating event network-vif-deleted:8434aa23-793d-4765-94c2-651d579a7981 for instance bd43f047-fa56-444b-8a9b-7d654a7c2ffa on hv-cinder-81566 Jan 31 17:11:56.919674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-15f6ee74-0141-4b6d-8e29-6df92170e3af req-3f38e724-0623-4585-b49e-7bb6e3bbf252 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188220 Jan 31 17:11:56.920611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 428/792] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:11:57.328376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:57.328994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:57.337276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:57.337834 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:57.338783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:57.339823 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:57.339973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:57.340493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:57.347652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:57.348230 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:57.349034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:57.349662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:57.428557 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:57.436352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e7ba3e49-e48d-4283-b7fb-0efc90505935 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1466 microversion: 2.1 time: 0.102139 Jan 31 17:11:57.436932 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 429/793] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:57 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1466 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:11:57.501230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:57.510621 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:57.512360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:57.513513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cf3a4f13-7840-476d-af3d-490d9d91df78 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.189273 Jan 31 17:11:57.514067 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 365/794] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:57 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:11:58.454019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:58.454628 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:58.461559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:58.462013 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:58.462797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:58.463236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:58.525912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:58.533439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:58.534529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5879d272-d9ae-4754-a4a4-27879b5a78cc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1466 microversion: 2.1 time: 0.083213 Jan 31 17:11:58.534676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:58.534844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 430/795] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:58 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1466 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:58.541095 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:58.541553 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:58.542349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:58.542794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:58.680812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:58.689089 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:58.691211 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:58.692400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2777eb69-8083-4315-9007-ffe4672453c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.162946 Jan 31 17:11:58.692950 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 366/796] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:58 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:11:59.552025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:59.552767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:59.558659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:59.559114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:59.559898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:59.560374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:59.622032 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:59.630177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6c68fcc4-53be-4469-bd20-4c37b468b725 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1293 microversion: 2.1 time: 0.082801 Jan 31 17:11:59.630783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 431/797] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:11:59 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:11:59.711310 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:11:59.711954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:11:59.718403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:59.719059 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:59.719909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:11:59.720372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:11:59.877328 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:59.886000 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:59.887490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:11:59.888676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ca2d515a-8da2-4d9a-a16d-44cd577a8c4f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.182105 Jan 31 17:11:59.889237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 367/798] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:11:59 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:00.648863 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:00.649473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:00.655716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:00.656265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:00.657085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:00.657535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:00.687465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:00.687917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:00.688394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lazy-loading 'fault' on Instance uuid bd43f047-fa56-444b-8a9b-7d654a7c2ffa {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:12:00.728968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:00.737510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c391cc04-902c-4db4-b66a-d6c673679a3f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 200 len: 1312 microversion: 2.1 time: 0.091718 Jan 31 17:12:00.738105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 432/799] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:00 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:00.906537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:00.907290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:00.914131 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:00.914591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:00.915390 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:00.915851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:01.062822 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:01.072095 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:01.073619 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:01.074774 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f5335ae1-1d93-4cc5-b7f7-da1e37ea7f2f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.171942 Jan 31 17:12:01.075337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 368/800] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:00 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:01.754965 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:01.755591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: bd43f047-fa56-444b-8a9b-7d654a7c2ffa] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:01.762383 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:01.762848 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:01.763645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:01.764299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:01.779865 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] HTTP exception thrown: Instance bd43f047-fa56-444b-8a9b-7d654a7c2ffa could not be found. Jan 31 17:12:01.780635 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Returning 404 to user: Instance bd43f047-fa56-444b-8a9b-7d654a7c2ffa could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:12:01.781415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b5116e2a-4567-4592-a0af-833d1d544bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa" status: 404 len: 111 microversion: 2.1 time: 0.031331 Jan 31 17:12:01.781970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 433/801] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:01 2022] GET /compute/v2.1/servers/bd43f047-fa56-444b-8a9b-7d654a7c2ffa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:12:01.791108 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:01.791606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:01.797942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:01.798488 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:01.799631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:01.800450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:01.825191 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:12:01.929563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c227e230-da54-4aa3-8611-4ffc6a8d07f7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "DELETE /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 204 len: 0 microversion: 2.1 time: 0.142592 Jan 31 17:12:01.934540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 369/802] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:12:01 2022] DELETE /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:12:01.941901 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:01.942533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:01.957330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:01.957820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:01.959101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:01.959632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:02.093576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:02.094301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:02.101216 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:02.101673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:02.102463 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:02.102900 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:02.113758 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:02.121514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4f96bc38-db16-4915-ad61-86bf0e4a58bc tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.185587 Jan 31 17:12:02.122089 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 434/803] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:01 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:02.126391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:02.126992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:02.133768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:02.134282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:02.135083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:02.135891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:02.311940 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:02.321388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:02.322869 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:02.324185 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fc36ced9-9467-4362-b68c-bff955b4e9fe tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.234932 Jan 31 17:12:02.324743 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 370/804] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:02 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:02.327854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:02.336820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f9fd709d-0dfa-444d-ae24-e242120cea4f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1594 microversion: 2.1 time: 0.213732 Jan 31 17:12:02.337393 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 435/805] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:02 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1594 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:03.138999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:03.139618 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:03.147942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:03.148427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:03.153864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:03.153864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:03.296394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:03.304509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-41563821-80ab-4ff2-a605-1d8ff396879e tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.169455 Jan 31 17:12:03.305224 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 371/806] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:03 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:03.344133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:03.345314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:03.352667 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:03.353129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:03.353927 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:03.354369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:03.528570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:03.537684 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:03.539256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:03.540961 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-da99b545-339a-4df1-b23e-313a9f1de308 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.200432 Jan 31 17:12:03.541631 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 436/807] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:03 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:04.322178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:04.322882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:04.329561 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:04.330010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:04.331804 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:04.332437 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:04.479547 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:04.489279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dd1c7aa5-4b46-4b51-85fe-e1e1b73dd179 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.170885 Jan 31 17:12:04.489991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 372/808] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:04 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:04.542360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-ed145c46-4f04-4b82-9063-82656d2478f2 req-1efadde8-c59d-4e3a-9567-cd220486c177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:04.544597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:12:04.544597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:12:04.553914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-ed145c46-4f04-4b82-9063-82656d2478f2 req-1efadde8-c59d-4e3a-9567-cd220486c177 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:04.554367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-ed145c46-4f04-4b82-9063-82656d2478f2 req-1efadde8-c59d-4e3a-9567-cd220486c177 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:04.564609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:04.566848 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:04.567111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-ed145c46-4f04-4b82-9063-82656d2478f2 req-1efadde8-c59d-4e3a-9567-cd220486c177 service nova] Creating event network-changed:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:12:04.573112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-ed145c46-4f04-4b82-9063-82656d2478f2 req-1efadde8-c59d-4e3a-9567-cd220486c177 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Jan 31 17:12:04.573635 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 437/809] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:12:04.575263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:04.577513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:04.578677 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:04.579158 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:04.819258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:04.833020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:04.836483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:04.838881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e2ca0be9-848a-4b98-a12e-b07786f8d438 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.280775 Jan 31 17:12:04.841227 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 373/810] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:04 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:05.507588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:05.508469 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:05.515025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:05.515588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:05.516479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:05.516981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:05.652773 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-547021589"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:05.653479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:05.671133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:05.673083 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:05.674945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:05.675513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:05.743597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:05.754218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1068ddfd-2ebf-4091-af47-5785a9aa4e8a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.250474 Jan 31 17:12:05.755007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 438/811] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:05 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:05.843617 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.network.security_group_api [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Adding security group 695876e0-3f52-4878-a92a-84a408143c36 to port 113a6e12-5c1e-439d-b292-bfffe7574544 Jan 31 17:12:05.860315 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:05.861226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:05.868508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:05.869121 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:05.870031 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:05.870552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:06.134653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:06.146170 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:06.147712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:06.148971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c0fbafd8-820b-4694-8c1b-64c35b20f8fb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.292393 Jan 31 17:12:06.149546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 439/812] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:05 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:06.319792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bdc76c8c-3d2d-4163-aa2f-3184828cb197 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/action" status: 202 len: 0 microversion: 2.1 time: 0.681076 Jan 31 17:12:06.320559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 374/813] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:12:05 2022] POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:12:06.328754 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:06.331185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:06.336063 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-9f8bf61a-e8f2-4be6-9727-ef29fb1866dd req-439845bd-c850-40c1-a428-19b514988455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:06.337814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:12:06.337814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:12:06.339263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:06.339753 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:06.340807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:06.341486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:06.345599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-9f8bf61a-e8f2-4be6-9727-ef29fb1866dd req-439845bd-c850-40c1-a428-19b514988455 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:06.346075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-9f8bf61a-e8f2-4be6-9727-ef29fb1866dd req-439845bd-c850-40c1-a428-19b514988455 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:06.360629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-9f8bf61a-e8f2-4be6-9727-ef29fb1866dd req-439845bd-c850-40c1-a428-19b514988455 service nova] Creating event network-changed:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:12:06.367732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-9f8bf61a-e8f2-4be6-9727-ef29fb1866dd req-439845bd-c850-40c1-a428-19b514988455 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036856 Jan 31 17:12:06.368664 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 375/814] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:06.628807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:06.637409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-39804a00-d9e3-4e1c-95bd-7496e264dbdd tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1640 microversion: 2.1 time: 0.312297 Jan 31 17:12:06.638005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 440/815] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:06 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1640 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:06.772198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:06.772829 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:06.779391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:06.779852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:06.780681 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:06.781129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:06.978318 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:06.985825 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f0fc3110-9c10-434c-8480-537840114ec1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.217828 Jan 31 17:12:06.986416 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 376/816] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:06 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:07.166553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:07.167322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:07.173650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:07.174653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:07.175486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:07.175928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:07.333841 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:07.344261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:07.346098 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:07.347960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-162cbe13-0018-4248-a354-c3f47f440a23 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.185037 Jan 31 17:12:07.352314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 441/817] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:07 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:08.007284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:08.008325 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:08.016056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:08.017269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:08.018262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:08.018805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:08.203008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:08.212141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-866fa2ba-b375-4715-9193-7fa234e64e24 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.211322 Jan 31 17:12:08.213483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 377/818] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:07 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:08.370702 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:08.371536 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:08.378891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:08.379341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:08.380171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:08.380610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:08.535335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:08.544174 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:08.545823 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:08.547126 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ef6a517b-7756-40ec-a620-503e39c285eb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.180179 Jan 31 17:12:08.547897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 442/819] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:08 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:09.238077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:09.238684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:09.245042 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:09.245498 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:09.246550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:09.246987 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:09.393471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:09.400978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5c197d4d-d191-4788-93cd-0504168af4ae tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.167149 Jan 31 17:12:09.401647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 378/820] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:09 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:09.569290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:09.569911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:09.576368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:09.576826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:09.577623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:09.578069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:09.720642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:09.729485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:09.730991 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:09.732204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b573339a-f3ff-45c0-b0ff-58c60ec4eee4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1752 microversion: 2.20 time: 0.167277 Jan 31 17:12:09.732782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 443/821] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:09 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:10.422173 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:10.423406 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:10.435821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:10.436887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:10.438365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:10.439270 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:10.606500 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:10.616045 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fac9bf12-eebe-4264-818a-9fb0bfc1628d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.200176 Jan 31 17:12:10.616769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 379/822] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:10 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:10.758420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:10.759004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:10.765602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:10.766058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:10.766861 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:10.767300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:10.909424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:10.917844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:10.919385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:10.920591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-80a9aca9-4565-4890-a16d-4fe10f36ac7f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.166255 Jan 31 17:12:10.921155 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 444/823] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:10 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:11.635475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:11.636723 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:11.643894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:11.644808 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:11.645821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:11.646480 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:11.824149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:11.849350 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-95055aa5-dbe6-4e3c-b459-5aabce366516 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.214252 Jan 31 17:12:11.850289 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 380/824] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:11 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:11.941492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:11.942347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:11.949606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:11.950224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:11.951114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:11.951712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:12.106642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:12.115835 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:12.117729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:12.119975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-316b6c0f-bd5e-49f2-b22a-3337d61cfda9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.183661 Jan 31 17:12:12.120579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 445/825] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:11 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:13.011386 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:13.012701 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:13.026326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:13.028985 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:13.031735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:13.032400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:13.142513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:13.143898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:13.157330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:13.159393 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:13.163141 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:13.163790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:13.298705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:13.310020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f2ef0e1f-fede-4e07-b5a5-7819b8ed208b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.436882 Jan 31 17:12:13.313886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 381/826] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:12 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:13.396254 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:13.405510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:13.407114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:13.408992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-66d121b9-a6bf-4445-b870-4f97ac929f86 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.272605 Jan 31 17:12:13.409967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 446/827] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:13 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:14.330775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:14.331720 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:14.339766 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:14.340249 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:14.341045 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:14.341788 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:14.428424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:14.429043 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:14.435398 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:14.436098 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:14.436644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:14.437082 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:14.514500 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:14.522629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a4e1817a-bb66-4dd3-9577-dba7ec5d6ed1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.195940 Jan 31 17:12:14.523232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 382/828] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:14 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:14.604885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:14.614468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:14.615982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:14.617204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8be7b330-c3df-4a5b-89ae-2b9dca1af95c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.193349 Jan 31 17:12:14.617772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 447/829] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:14 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:15.540046 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:15.540714 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:15.547010 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:15.547465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:15.548291 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:15.548849 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:15.644395 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:15.661516 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:15.680862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:15.682007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:15.683685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:15.684774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:15.726585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:15.734552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-29ae81ea-1430-472b-a477-871b47679c73 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.198081 Jan 31 17:12:15.735149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 383/830] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:15 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:15.855357 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:15.865021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:15.866538 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:15.867720 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1112e1b2-653b-4b9d-ac34-cc3917896c9e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.233044 Jan 31 17:12:15.868335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 448/831] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:15 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:16.755588 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:16.759300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:16.765545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:16.766003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:16.766803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:16.767289 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:16.886351 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:16.886986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:16.894326 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:16.894791 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:16.895599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:16.896271 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:16.912305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:16.919631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-28483539-7ae5-4fc2-bc23-4d6155eb000d tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.167986 Jan 31 17:12:16.920239 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 384/832] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:16 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:17.038130 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:17.046982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:17.048502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:17.050818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-31775991-13fc-4b35-ac99-b85ea191acd5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.168399 Jan 31 17:12:17.051394 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 449/833] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:16 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:17.937536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:17.938302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:17.945210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:17.945663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:17.946446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:17.946884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:18.073015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:18.073905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:18.087968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:18.088792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:18.090213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:18.091572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:18.121287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:18.143188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-55988a81-f321-45fb-861e-6a71454f4b96 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.207098 Jan 31 17:12:18.144843 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 385/834] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:17 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:18.275916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:18.285278 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:18.286799 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:18.287983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2ef467e0-ee15-4dae-8159-e06f04a68954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.220603 Jan 31 17:12:18.288596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 450/835] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:18 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:19.163174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:19.165186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:19.176194 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:19.182907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:19.182907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:19.182907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:19.306205 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:19.306877 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:19.313827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:19.314082 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:19.315417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:19.315892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:19.343606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:19.351805 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a263780b-96ab-44a5-9b3b-4e250abca7a1 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.193729 Jan 31 17:12:19.353174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 386/836] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:19 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:19.466042 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:19.475204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:19.476851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:19.478059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-96da47f2-bfac-478b-9972-88f7db014257 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.175737 Jan 31 17:12:19.478849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 451/837] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:19 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:20.369712 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:20.370353 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:20.377159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:20.377159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:20.378401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:20.378843 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:20.497184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:20.497908 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:20.504707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:20.505172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:20.505988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:20.506436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:20.515464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:20.524433 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5688368c-ec9f-466b-8406-ce82973046dd tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.158340 Jan 31 17:12:20.525093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 387/838] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:20 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:20.651709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:20.660895 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:20.662390 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:20.663575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-beabf7ac-c6e4-4a42-b26a-b63be8b1bdf8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.170600 Jan 31 17:12:20.664164 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 452/839] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:20 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:21.542297 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:21.542903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:21.550174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:21.550626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:21.551480 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:21.551917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:21.683265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:21.684949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:21.692735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:21.693569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:21.694398 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:21.694843 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:21.714993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:21.724923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-14a51270-136c-46d3-b0d5-de2e3f80a8c0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.186224 Jan 31 17:12:21.734590 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 388/840] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:21 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:21.906579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:21.938570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:21.942116 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:21.944331 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-030e1857-0e82-4e95-a853-eafcdf8f6b96 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.264686 Jan 31 17:12:21.951907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5bec196-1ea6-4af2-a18b-4d46ad89ee5c", "device": "/dev/sdb"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:21.955474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:21.961788 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 453/841] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:21 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:21.984477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:21.985248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:21.992280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:21.993550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:22.742868 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:22.743649 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:22.750753 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:22.751245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:22.752159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:22.752899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:22.941712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:22.950123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-95f13f73-311a-4e5e-82f8-4a05cfeab090 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.210913 Jan 31 17:12:22.950707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 454/842] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:22 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:22.977542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:22.977542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:22.983405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:22.983911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:22.984724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:22.985209 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:23.185900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:23.197312 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:23.198672 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:23.200257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f6418534-5944-498d-a345-f97ea8c6203c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.230482 Jan 31 17:12:23.201409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 455/843] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:22 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:23.974287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:23.974960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:23.981330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:23.981792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:23.982602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:23.983045 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:24.153967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:24.163532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-70bc32ae-eb03-42a2-99b3-44798266a807 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.192833 Jan 31 17:12:24.164159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 456/844] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:23 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:24.221542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:24.222334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:24.228547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:24.229012 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:24.229814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:24.230262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:24.372013 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:24.381594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:24.383102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:24.384319 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-12eb84f5-445a-4a3a-b42b-4b4a586427cd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.167340 Jan 31 17:12:24.384893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 457/845] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:24 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:25.180747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:25.181514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:25.190003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:25.190514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:25.191332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:25.191822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:25.370590 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:25.379338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-58e7f078-ed41-4157-99b0-8a53a6ccef41 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.202289 Jan 31 17:12:25.379925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 458/846] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:25 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:25.402593 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:25.403263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:25.410538 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:25.410989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:25.411781 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:25.412250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:25.557064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:25.568592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:25.570093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:25.571425 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6777efaa-99eb-46d5-95be-a8105063c421 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.172473 Jan 31 17:12:25.572268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 459/847] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:25 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:26.396896 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:26.397810 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:26.403708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:26.404441 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:26.405238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:26.405681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:26.575466 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:26.584914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-278e3176-fc6a-499a-8ac9-a1f6761bfdde tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.192371 Jan 31 17:12:26.586024 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 460/848] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:26 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:26.591866 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:26.592499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:26.600587 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:26.601113 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:26.601982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:26.602418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:26.797207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:26.811454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:26.812983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:26.815963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7554ce32-0673-4940-84fe-a0ca9da323e5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.227054 Jan 31 17:12:26.816573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 461/849] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:26 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:27.602679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:27.603367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:27.609785 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:27.610244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:27.612666 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:27.613277 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:27.770519 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:27.779618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-41645622-ce03-4767-bf7e-de2a469d9bb7 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.180633 Jan 31 17:12:27.780227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 462/850] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:27 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:27.835881 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:27.836534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:27.842700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:27.843170 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:27.843971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:27.844444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:27.994842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:28.004391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:28.005986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:28.007271 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c1c4046d-a0bc-4bae-8ca5-98be6c492647 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.176028 Jan 31 17:12:28.007846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 463/851] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:27 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:28.797007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:28.797668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:28.805010 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:28.805474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:28.806531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:28.807151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:28.955776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:28.964211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1c407f65-9566-48cc-9093-fc2f8fc4a606 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.170770 Jan 31 17:12:28.964954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 464/852] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:28 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:29.026281 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:29.026906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:29.033043 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:29.033507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:29.034310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:29.034759 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:29.208265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:29.220748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:29.222452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:29.223659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9a017e25-4f3c-4026-b3f7-4876848858a0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.201201 Jan 31 17:12:29.231377 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 465/853] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:29 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:29.983016 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:29.983755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:29.992093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:29.993064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:29.994101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:29.994908 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:30.144413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:30.152275 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-70c0047b-7775-4a4f-8541-c37cb5445ece tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.172978 Jan 31 17:12:30.152905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 466/854] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:29 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:30.243384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:30.244056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:30.250887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:30.251979 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:30.252970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:30.253473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:30.432633 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:30.445368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:30.448403 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:30.450422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d5e99bd6-f9fb-442c-90b6-6f1eea0c87e1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.210891 Jan 31 17:12:30.451129 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 467/855] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:30 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:30.519760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:12:30.520059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:12:31.173273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:31.174652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:31.181803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:31.182260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:31.183067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:31.183512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:31.357684 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:31.365410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1e37ac85-d428-46ce-97a4-f9de6efff274 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.198814 Jan 31 17:12:31.365986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 468/856] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:31 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:31.766517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:31.767773 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:31.774356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:31.774822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:31.775629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:31.776090 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:31.981543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:31.991519 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:31.993064 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:31.994252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1f5f2ba8-187b-4823-8cf8-ba4a76721be0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.527931 Jan 31 17:12:31.994893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 469/857] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:31 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:32.382650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:32.383748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:32.390315 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:32.391074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:32.392536 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:32.393034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:32.835702 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:32.843381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c07bfd7f-c3a1-4a4f-838d-1815decfee69 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.464474 Jan 31 17:12:32.843994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 470/858] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:32 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:33.015612 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:33.016654 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:33.025930 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:33.026392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:33.027201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:33.027644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:33.173224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:33.182368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:33.183863 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:33.185062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f34f12a9-856e-4c94-a75e-f2b8bce3be4c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.174358 Jan 31 17:12:33.185627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 471/859] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:33 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:33.860607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:33.861734 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:33.869547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:33.870009 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:33.871167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:33.871508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:34.035780 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:34.043763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b127b0b7-e730-4c8c-bf9b-134d6fbe955f tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.187043 Jan 31 17:12:34.044524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 472/860] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:33 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:34.208526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:34.209741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:34.220343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:34.221164 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:34.222610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:34.223410 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:34.491846 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:34.506031 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:34.507548 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:34.508792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-034ccd29-bf2a-4319-a1cf-7b6040ae0e50 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.305881 Jan 31 17:12:34.509365 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 473/861] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:34 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:35.067286 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:35.068479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:35.080267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:35.081085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:35.082466 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:35.083243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:35.257474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:35.267634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56dd63e4-5055-4684-8c3b-6a4b84021b3b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.207292 Jan 31 17:12:35.268662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 474/862] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:35 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:35.526939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:35.527560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:35.534881 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:35.535343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:35.536200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:35.536653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:35.709983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:35.724342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:35.726857 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:35.728710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0884c6fd-63e9-4013-8539-0339c3b7c2b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.205464 Jan 31 17:12:35.729797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 475/863] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:35 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:36.297195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:36.299084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:36.309836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:36.310645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:36.312135 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:36.312924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:36.486766 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:36.495243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-92485051-2627-4fdb-bae1-fdb5d574650a tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.203274 Jan 31 17:12:36.496387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 476/864] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:36 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:36.759214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:36.760039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:36.767285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:36.767747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:36.768609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:36.769057 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:36.939510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:36.957781 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:36.960712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:36.962906 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-85202f8f-f365-47e7-8dd6-a8ec1d3f0526 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.207162 Jan 31 17:12:36.963908 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 477/865] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:36 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:37.148268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bbae8caa-07c5-4d14-83be-d3a1c6fd1b86 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "POST /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.202355 Jan 31 17:12:37.149304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 389/866] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:12:21 2022] POST /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0/os-volume_attachments => generated 194 bytes in 15204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:37.517807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:37.518838 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:37.527011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:37.527546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:37.528489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:37.529263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:37.721648 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:37.735097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-dbbeddea-ce77-419b-82fa-6cb1e6cefe14 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.223155 Jan 31 17:12:37.736249 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 478/867] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:37 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:37.991597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:37.992861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:38.005055 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:38.005542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:38.006427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:38.006877 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:38.239357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:38.251820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:38.253903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:38.255294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-481fce9e-a438-439f-8965-9ab1b709100f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.272222 Jan 31 17:12:38.255996 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 390/868] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:37 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:38.762511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:38.763583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:38.776360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:38.777246 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:38.778690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:38.779555 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:38.957051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:38.965687 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56889651-d590-4d26-b243-32dbf728976b tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.207838 Jan 31 17:12:38.966392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 479/869] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:38 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:39.289470 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:39.290624 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:39.302069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:39.302866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:39.304345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:39.305175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:39.506286 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:39.516284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:39.518846 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:39.520576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f1a067b4-897f-46b4-b831-bebdfab33baa tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.238619 Jan 31 17:12:39.521336 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 391/870] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:39 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:39.995966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:39.997077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:40.010106 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:40.010920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:40.012436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:40.013260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:40.213992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:40.227476 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9d35f937-2994-4a96-9519-fcf4c7e020a8 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.238908 Jan 31 17:12:40.228512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 480/871] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:39 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:40.544893 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:40.546025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:40.556949 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:40.557751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:40.559127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:40.559897 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:40.776628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:40.790831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:40.793429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:40.795279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6f7a42ae-556a-4562-8c46-5a5e682b2b4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.258119 Jan 31 17:12:40.796218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 392/872] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:40 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:41.255370 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:41.256414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:41.267040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:41.268740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:41.270182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:41.270948 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:41.428774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:41.437316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-724f53fa-bfc6-45b6-9d46-b9d1ee439d9c tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.187900 Jan 31 17:12:41.437986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 481/873] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:41 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:41.817183 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:41.817936 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:41.824466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:41.824918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:41.825721 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:41.826167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:41.984537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:41.993463 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:41.994957 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:41.996413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6bbe93a6-331f-4057-af95-211c56915968 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.183903 Jan 31 17:12:41.996975 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 393/874] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:41 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:42.456928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:42.457663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:42.464644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:42.465243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:42.466147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:42.466769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:42.649631 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:42.662834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-26e84f76-77f6-4abc-be9c-a5b79a959cd4 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1521 microversion: 2.1 time: 0.209562 Jan 31 17:12:42.663845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 482/875] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:42 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:12:43.016197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:43.016887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:43.027802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:43.028648 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:43.030098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:43.030861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:43.244802 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:43.256168 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:43.258233 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:43.259447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-713b5719-7060-4905-b7a2-6d46041d96e6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.247813 Jan 31 17:12:43.260023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 394/876] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:43 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:43.438447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-84f9b8a0-000b-4b26-816a-0380fcc44f6a req-783af299-03b2-400a-92b6-9993cd107c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee59a59-7ed3-4b35-8a54-a257556f657c", "name": "network-vif-deleted", "tag": "43e0b7d5-4414-4dd9-92d3-0c1b9fddd337"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:43.440409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:12:43.440409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:12:43.450469 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-84f9b8a0-000b-4b26-816a-0380fcc44f6a req-783af299-03b2-400a-92b6-9993cd107c5e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:43.450917 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-84f9b8a0-000b-4b26-816a-0380fcc44f6a req-783af299-03b2-400a-92b6-9993cd107c5e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:43.467000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-84f9b8a0-000b-4b26-816a-0380fcc44f6a req-783af299-03b2-400a-92b6-9993cd107c5e service nova] Creating event network-vif-deleted:43e0b7d5-4414-4dd9-92d3-0c1b9fddd337 for instance 1ee59a59-7ed3-4b35-8a54-a257556f657c on hv-cinder-81566 Jan 31 17:12:43.473681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-84f9b8a0-000b-4b26-816a-0380fcc44f6a req-783af299-03b2-400a-92b6-9993cd107c5e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119819 Jan 31 17:12:43.474323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 483/877] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:12:43.680826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:43.681564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:43.690871 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:43.691689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:43.693077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:43.693775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:43.738536 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:43.739237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:43.740060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lazy-loading 'fault' on Instance uuid 1ee59a59-7ed3-4b35-8a54-a257556f657c {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:12:43.801833 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8dddb4201c494daba6b323eb5980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df34a02610e4463d9412c1f6b414a895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:43.809893 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4be77b03-abf1-4813-b1f1-56ea3aee2b84 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 200 len: 1311 microversion: 2.1 time: 0.133531 Jan 31 17:12:43.810476 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 395/878] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:43 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:12:44.281709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:44.282933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:44.290065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:44.290534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:44.291513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:44.291968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:44.467186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:44.480200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:44.482143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:44.483675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-593af76d-44c8-4560-a798-4cbadd98428c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.206101 Jan 31 17:12:44.484268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 484/879] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:44 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:44.829761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:44.830748 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] [instance: 1ee59a59-7ed3-4b35-8a54-a257556f657c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:44.837492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:44.837948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:44.838748 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:44.839193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:44.853619 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] HTTP exception thrown: Instance 1ee59a59-7ed3-4b35-8a54-a257556f657c could not be found. Jan 31 17:12:44.854218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] Returning 404 to user: Instance 1ee59a59-7ed3-4b35-8a54-a257556f657c could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:12:44.855052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-85d0fc55-e6f1-48c0-aeab-34c3fe33a8e0 tempest-ServerRescueNegativeTestJSON-1641788603 tempest-ServerRescueNegativeTestJSON-1641788603-project] 10.222.0.91 "GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c" status: 404 len: 111 microversion: 2.1 time: 0.031095 Jan 31 17:12:44.855606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 396/880] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:12:44 2022] GET /compute/v2.1/servers/1ee59a59-7ed3-4b35-8a54-a257556f657c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:12:45.510459 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:45.511554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:45.523005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:45.523843 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:45.525338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:45.526162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:45.827309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:45.845022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:45.847182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:45.848555 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-979fea65-8ec2-4e82-88f4-f5468e2276c1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.347819 Jan 31 17:12:45.858200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 485/881] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:45 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:46.868255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:46.869094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:46.879911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:46.880822 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:46.882322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:46.883098 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:47.296190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:47.311396 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:47.316361 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:47.323258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c3f8a720-f722-4ec7-b03e-681b85c6ad06 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.458688 Jan 31 17:12:47.324994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 397/882] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:46 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:48.352708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:48.354711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:48.365015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:48.366121 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:48.367184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:48.367729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:48.570322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:48.579180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:48.581003 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:48.582942 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6c8083cf-c283-4c1a-876f-6304a6709f5f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.236943 Jan 31 17:12:48.583580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 486/883] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:48 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:49.609573 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:49.611743 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:49.618383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:49.618923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:49.619799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:49.620533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:49.779955 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:49.791491 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:49.794524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:49.794524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-729e782e-9271-4c91-9704-50a706437857 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.189142 Jan 31 17:12:49.794524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 398/884] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:49 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:50.493167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a019cafd-16b9-4826-a21a-a96f680c6d39 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Action: 'create', calling method: .version_select at 0x7fdce27f6310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-603889391"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:50.823720 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:50.825008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:50.833126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:50.833860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:50.834888 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:50.835694 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:50.920946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a019cafd-16b9-4826-a21a-a96f680c6d39 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.579846 Jan 31 17:12:50.935627 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 487/885] 10.222.0.91 () {60 vars in 1154 bytes} [Mon Jan 31 17:12:50 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 31 17:12:50.951283 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d479c3a1-c3fa-4f10-9032-254c59449c31 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce279cb80>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:51.117819 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:51.134272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:51.137204 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:51.139929 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-317475a0-6bed-4f74-8a0b-782dc08c0633 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.319752 Jan 31 17:12:51.142607 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 399/886] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:50 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:51.259905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d479c3a1-c3fa-4f10-9032-254c59449c31 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 200 len: 344 microversion: 2.1 time: 0.320184 Jan 31 17:12:51.261516 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 488/887] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:12:50 2022] GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 344 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:51.402388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:51.402963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:51.410873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:51.411321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:51.412136 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:51.412599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:51.548378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lazy-loading 'services' on Instance uuid 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:12:51.668252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4d2f21d0-9bc0-48e8-ad87-f375dd14fe7e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-volume_attachments/cfaf7659-bb9f-4936-9b95-105dd6030af3" status: 202 len: 0 microversion: 2.1 time: 0.427998 Jan 31 17:12:51.669114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 400/888] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:12:51 2022] DELETE /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-volume_attachments/cfaf7659-bb9f-4936-9b95-105dd6030af3 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:12:52.182380 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:52.185187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:52.191083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:52.191792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:52.193093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:52.193821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:52.277440 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a96222d2-d192-48f1-9c74-abc83122b9e7 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce28ba700>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:52.352769 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a96222d2-d192-48f1-9c74-abc83122b9e7 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 200 len: 345 microversion: 2.1 time: 0.080719 Jan 31 17:12:52.353384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 401/889] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:12:52 2022] GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:12:52.371626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e3588bca-4c31-4c12-b89d-5e92f77f9764 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Action: 'create', calling method: .version_select at 0x7fdce2721670>, body: {"snapshot": {"volume_id": "9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-530902594"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:52.417046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:52.435813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:52.440496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:52.443165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2d46a727-f016-42af-b58e-c01783dd7b89 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.268629 Jan 31 17:12:52.444185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 489/890] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:52 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:52.677163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e3588bca-4c31-4c12-b89d-5e92f77f9764 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.311923 Jan 31 17:12:52.678115 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 402/891] 10.222.0.91 () {60 vars in 1161 bytes} [Mon Jan 31 17:12:52 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:12:52.692018 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-16b9f7bc-9a3a-463c-9c4e-1084955bd879 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27cb310>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:52.738784 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-16b9f7bc-9a3a-463c-9c4e-1084955bd879 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.053735 Jan 31 17:12:52.739822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 490/892] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:52 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:52.754783 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-467c12ab-9179-4705-9d5e-126e8db0a77d tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce2729820>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:52.800445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-467c12ab-9179-4705-9d5e-126e8db0a77d tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.050755 Jan 31 17:12:52.806198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 403/893] 10.222.0.91 () {58 vars in 1139 bytes} [Mon Jan 31 17:12:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:52.819166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7e884d92-b4ba-4d64-afd7-06c66cedf54b tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27cbee0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:52.867928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7e884d92-b4ba-4d64-afd7-06c66cedf54b tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.055832 Jan 31 17:12:52.868570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 491/894] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:52 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:53.466435 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:53.467175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:53.477181 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:53.478027 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:53.479506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:53.480374 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:53.697126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:53.710776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:53.713067 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:53.714803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-29e1aba1-7c5e-4bbf-90fa-2692f8de7081 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.252540 Jan 31 17:12:53.715548 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 404/895] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:53 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:53.883481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5b8e53b7-0ff1-41e0-b954-dff60167cadd tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce25f6b80>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:53.934789 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5b8e53b7-0ff1-41e0-b954-dff60167cadd tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.057957 Jan 31 17:12:53.935432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 492/896] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:53 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:54.738844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:54.739709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:54.751606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:54.752337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:54.753378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:54.753943 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:54.956026 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-abb6a069-398f-400e-88f0-0eb66f99f2f5 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26058b0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:54.976016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:54.990450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:54.993608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:54.996219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8d39f5c5-8035-460a-a234-98e7d91d57d6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.264183 Jan 31 17:12:54.997268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 405/897] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:54 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:55.013026 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-abb6a069-398f-400e-88f0-0eb66f99f2f5 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.067250 Jan 31 17:12:55.013641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 493/898] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:54 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:56.025200 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:56.025928 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:56.027263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4ecff40e-f0f0-44f4-aa94-a4d4b3294a83 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26fe550>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:56.032640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:56.033107 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:56.033916 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:56.034360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:56.087813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4ecff40e-f0f0-44f4-aa94-a4d4b3294a83 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.065487 Jan 31 17:12:56.088439 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 494/899] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:56 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:12:56.217114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:56.228272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:56.230064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:56.231406 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-37d3b9cf-f837-4f41-9f4b-fed842ccba33 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.209990 Jan 31 17:12:56.232076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 406/900] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:56 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:57.100762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b51a5e49-c262-4dab-ab8a-a524877a4c17 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27cb670>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:57.165510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b51a5e49-c262-4dab-ab8a-a524877a4c17 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.068901 Jan 31 17:12:57.166157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 495/901] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:57 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:57.256926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:57.258026 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:57.269198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:57.269989 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:57.271350 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:57.272081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:57.448338 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:57.457472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:57.459102 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:57.460367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-35a47187-034e-4639-95e7-be8c10bfea71 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.210304 Jan 31 17:12:57.460954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 407/902] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:57 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:12:58.180796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fc2d1fea-2f94-4df3-a6f5-a40585193b61 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27f6940>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:58.227168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fc2d1fea-2f94-4df3-a6f5-a40585193b61 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.051984 Jan 31 17:12:58.228065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 496/903] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:58 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:58.486996 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:58.487999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:58.495401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:58.496034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:58.496973 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:58.497512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:58.690764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:58.700399 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:58.702108 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:58.703941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-64552fc8-dea0-4d2a-aa2c-1f7c9bae3667 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.220123 Jan 31 17:12:58.704948 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 408/904] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:58 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:12:59.138609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-92d95992-eae8-4575-bdcf-03d006f5c516 req-4c4c38de-8126-4768-9cd9-5296826cbb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "name": "network-vif-plugged", "status": "completed", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:12:59.140220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:12:59.140220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:12:59.153523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-92d95992-eae8-4575-bdcf-03d006f5c516 req-4c4c38de-8126-4768-9cd9-5296826cbb24 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:59.154257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-92d95992-eae8-4575-bdcf-03d006f5c516 req-4c4c38de-8126-4768-9cd9-5296826cbb24 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:59.173604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-92d95992-eae8-4575-bdcf-03d006f5c516 req-4c4c38de-8126-4768-9cd9-5296826cbb24 service nova] Creating event network-vif-plugged:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:12:59.184338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-92d95992-eae8-4575-bdcf-03d006f5c516 req-4c4c38de-8126-4768-9cd9-5296826cbb24 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128192 Jan 31 17:12:59.186294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 497/905] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:59.244355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6efcd588-3677-47de-8f0a-203c75f3cca4 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce2718430>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:59.290879 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6efcd588-3677-47de-8f0a-203c75f3cca4 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.053017 Jan 31 17:12:59.291450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 409/906] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:12:59 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:12:59.723462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:12:59.724234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:12:59.730946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:59.731408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:59.732258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:12:59.732700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:12:59.910711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:59.920236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:59.921740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:12:59.923871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-244ebda8-27a1-42c7-96ef-9aa2b609e595 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.205013 Jan 31 17:12:59.924485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 498/907] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:12:59 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:00.308356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fe739e1f-214d-40c6-b859-4e6484d3aaf5 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26de3a0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:00.378349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fe739e1f-214d-40c6-b859-4e6484d3aaf5 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.076981 Jan 31 17:13:00.378991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 410/908] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:00 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:00.946270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:00.947417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:00.960057 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:00.960970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:00.962319 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:00.963060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:01.194109 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:01.209671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:01.212270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:01.214295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6888223c-91e2-4eea-b8a0-d633f3b9ef14 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.274323 Jan 31 17:13:01.215221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 499/909] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:00 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:01.392854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b51d4ef7-515f-4b8b-8a4c-ef77f6a46462 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce2729dc0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:01.450961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b51d4ef7-515f-4b8b-8a4c-ef77f6a46462 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 287 microversion: 2.1 time: 0.062359 Jan 31 17:13:01.451599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 411/910] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:01 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:01.464017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-416ffcba-4778-43e8-b29e-47db9ad5254e tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27b7310>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:01.541220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-416ffcba-4778-43e8-b29e-47db9ad5254e tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "DELETE /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 202 len: 0 microversion: 2.1 time: 0.080558 Jan 31 17:13:01.542127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 500/911] 10.222.0.91 () {58 vars in 1253 bytes} [Mon Jan 31 17:13:01 2022] DELETE /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:13:01.551812 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0c7799c0-2621-4f1d-aa00-0d97357aaf51 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27dd310>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:01.590348 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0c7799c0-2621-4f1d-aa00-0d97357aaf51 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.042415 Jan 31 17:13:01.591099 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 412/912] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:01 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:02.246432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:02.247554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:02.257506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:02.258112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:02.259434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:02.260282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:02.473412 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:02.482671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:02.484767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:02.486002 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56289f12-fe17-4280-892f-776a7b1dbd66 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.247400 Jan 31 17:13:02.486588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 501/913] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:02 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:02.607478 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8152c272-4ce6-4cc3-aa27-099a79882496 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce2778280>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:02.652269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8152c272-4ce6-4cc3-aa27-099a79882496 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.050714 Jan 31 17:13:02.652839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 413/914] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:02 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:03.505485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:03.506116 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:03.514387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:03.514867 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:03.516154 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:03.516866 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:03.669195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1123074e-397a-4799-8222-f631379f7f3f tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27184c0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:03.711103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1123074e-397a-4799-8222-f631379f7f3f tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.049080 Jan 31 17:13:03.712135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 414/915] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:03 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:03.720644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:03.737223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:03.738336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:03.739641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cb105160-92f9-4b17-9310-95a58e9e4579 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.237924 Jan 31 17:13:03.740273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 502/916] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:03 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:04.727091 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0e997852-27d3-456e-bbff-a54eed5ff6fb tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce2778820>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:04.760241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:04.760985 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:04.770903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0e997852-27d3-456e-bbff-a54eed5ff6fb tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 200 len: 286 microversion: 2.1 time: 0.048667 Jan 31 17:13:04.772070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 415/917] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:04 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:04.772599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:04.773498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:04.774715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:04.775227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:04.986348 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:04.997351 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:04.999510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:05.002058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-63af3c08-9a18-4eec-89e1-032969f46f53 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.246236 Jan 31 17:13:05.002718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 503/918] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:04 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:13:05.789640 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95b9c5de-3ef5-48a1-95f9-f88a104ee331 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:05.790602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-739fcb80-af33-4920-823d-58790c2c1477 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26de8b0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:05.801124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95b9c5de-3ef5-48a1-95f9-f88a104ee331 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:05.801669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95b9c5de-3ef5-48a1-95f9-f88a104ee331 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:05.828679 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-739fcb80-af33-4920-823d-58790c2c1477 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] HTTP exception thrown: Snapshot 38331199-dd87-44d8-ab9e-bd0046caec1b could not be found. Jan 31 17:13:05.829682 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-739fcb80-af33-4920-823d-58790c2c1477 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Returning 404 to user: Snapshot 38331199-dd87-44d8-ab9e-bd0046caec1b could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:13:05.830176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-95b9c5de-3ef5-48a1-95f9-f88a104ee331 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Going to try to stop instance {{(pid=116483) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 31 17:13:05.831467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-739fcb80-af33-4920-823d-58790c2c1477 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b" status: 404 len: 111 microversion: 2.1 time: 0.047327 Jan 31 17:13:05.832384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 416/919] 10.222.0.91 () {58 vars in 1250 bytes} [Mon Jan 31 17:13:05 2022] GET /compute/v2.1/os-snapshots/38331199-dd87-44d8-ab9e-bd0046caec1b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:13:05.842689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ef79a6c5-c7f1-4ceb-a87c-f86b220b9ca4 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce2783040>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:05.899169 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-95b9c5de-3ef5-48a1-95f9-f88a104ee331 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action" status: 202 len: 0 microversion: 2.1 time: 0.114650 Jan 31 17:13:05.900295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 504/920] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:13:05 2022] POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:13:05.912664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:05.914032 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:05.923337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:05.924154 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:05.925596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:05.926300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:05.935976 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ef79a6c5-c7f1-4ceb-a87c-f86b220b9ca4 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 202 len: 0 microversion: 2.1 time: 0.096805 Jan 31 17:13:05.936913 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 417/921] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Jan 31 17:13:05 2022] DELETE /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:13:05.949112 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ef400fce-a1cf-444d-96b7-251664ed96f4 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26de820>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:06.018777 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ef400fce-a1cf-444d-96b7-251664ed96f4 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 200 len: 344 microversion: 2.1 time: 0.075594 Jan 31 17:13:06.020158 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 418/922] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:13:05 2022] GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:06.028722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:06.030001 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:06.041025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:06.041515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:06.042322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:06.042767 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:06.180885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:06.190748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6f7e007a-9442-4005-86a0-d3e886eb9105 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.283271 Jan 31 17:13:06.191356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 505/923] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:05 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:06.293083 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:06.305991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:06.307663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:06.309052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0cb5e180-d6ff-4a57-b653-40b55e6d1d4d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.287610 Jan 31 17:13:06.309711 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 419/924] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:06 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:07.038198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-38bef50c-3cd7-4f45-bfa0-2abc675d6b5d tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26e31f0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:07.087369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-38bef50c-3cd7-4f45-bfa0-2abc675d6b5d tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] HTTP exception thrown: Volume 9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 could not be found. Jan 31 17:13:07.088599 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-38bef50c-3cd7-4f45-bfa0-2abc675d6b5d tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Returning 404 to user: Volume 9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:13:07.090313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-38bef50c-3cd7-4f45-bfa0-2abc675d6b5d tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 404 len: 109 microversion: 2.1 time: 0.058053 Jan 31 17:13:07.091397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 506/925] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:13:07 2022] GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:13:07.106690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-de9a1009-9591-457d-8abf-a2171630ee7b tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce26deca0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:07.148644 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-de9a1009-9591-457d-8abf-a2171630ee7b tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] HTTP exception thrown: Volume 9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 could not be found. Jan 31 17:13:07.149633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-de9a1009-9591-457d-8abf-a2171630ee7b tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Returning 404 to user: Volume 9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:13:07.151077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-de9a1009-9591-457d-8abf-a2171630ee7b tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "DELETE /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 404 len: 109 microversion: 2.1 time: 0.051132 Jan 31 17:13:07.152022 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 420/926] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Jan 31 17:13:07 2022] DELETE /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:13:07.164306 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-25b1add9-9060-4183-8c95-57072d8a2cb8 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Calling method '.version_select at 0x7fdce27ffca0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:07.208545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:07.209314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:07.217861 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-25b1add9-9060-4183-8c95-57072d8a2cb8 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] HTTP exception thrown: Volume 9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 could not be found. Jan 31 17:13:07.218312 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:07.219833 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-25b1add9-9060-4183-8c95-57072d8a2cb8 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] Returning 404 to user: Volume 9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:13:07.220473 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:07.221537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:07.221714 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-25b1add9-9060-4183-8c95-57072d8a2cb8 tempest-VolumesSnapshotsTestJSON-205693866 tempest-VolumesSnapshotsTestJSON-205693866-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1" status: 404 len: 109 microversion: 2.1 time: 0.063207 Jan 31 17:13:07.222282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:07.222963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 507/927] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:13:07 2022] GET /compute/v2.1/os-volumes/9aac6dbe-bf22-41aa-93ae-0e6d2d657fa1 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:13:07.334552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:07.335707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:07.345733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:07.347233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:07.349926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:07.350744 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:07.538233 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:07.558784 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b2e33485-a588-42f5-b8f9-6e2c5fe3b34b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.352281 Jan 31 17:13:07.560759 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 421/928] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:07 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:07.677249 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:07.693216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:07.696084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:07.698322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1293773f-c285-4efe-99cf-c1627fc73c15 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1808 microversion: 2.20 time: 0.370238 Jan 31 17:13:07.699106 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 508/929] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:07 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1808 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:08.581363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:08.582513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:08.591197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:08.591760 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:08.592764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:08.593557 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:08.730532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:08.732609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:08.746762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:08.747570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:08.748999 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:08.751035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:08.873379 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:08.886506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9ae7c0e8-5042-4ba5-8103-2178bf0b21fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.310843 Jan 31 17:13:08.887472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 422/930] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:08 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:08.894349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:08.895024 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:08.902134 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:08.902774 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:08.904387 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:08.905094 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:09.002416 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:09.018831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:09.022240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:09.024518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e7b730dd-2481-4875-a84e-bcb684de746b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1795 microversion: 2.20 time: 0.306018 Jan 31 17:13:09.028193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 509/931] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:13:08 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1795 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:13:09.048814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lazy-loading 'services' on Instance uuid ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:13:09.175257 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1f4c129e-d09c-4acb-bcdc-8f722a73e422 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0/os-volume_attachments/d5bec196-1ea6-4af2-a18b-4d46ad89ee5c" status: 202 len: 0 microversion: 2.1 time: 0.285765 Jan 31 17:13:09.178715 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 423/932] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:13:08 2022] DELETE /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0/os-volume_attachments/d5bec196-1ea6-4af2-a18b-4d46ad89ee5c => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:13:09.911048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:09.912642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:09.927384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:09.928266 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:09.930158 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:09.930970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:10.171922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:10.184923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1a892889-559c-4ac7-ab59-c83260869da0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.280267 Jan 31 17:13:10.185890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 510/933] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:09 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:11.033003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-362176f9-072a-45e5-aebf-2b2fd4f8e10f tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce2718310>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:11.099632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-362176f9-072a-45e5-aebf-2b2fd4f8e10f tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/fb47fd15-526d-442b-8cf4-e3544c95bc7c" status: 200 len: 350 microversion: 2.1 time: 0.073035 Jan 31 17:13:11.100318 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 424/934] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:13:11 2022] GET /compute/v2.1/os-volumes/fb47fd15-526d-442b-8cf4-e3544c95bc7c => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:11.205187 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:11.206237 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:11.213739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:11.214521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:11.215577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:11.216026 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:11.487347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:11.493335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:11.493335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:11.495837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8879570b-e611-40be-b294-7d90f0fa22eb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.294260 Jan 31 17:13:11.497601 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 511/935] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:11 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:11.502637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:11.503130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:11.504186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:11.504829 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:11.548036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:13:11.653560 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4c2324ab-63fd-4be6-b9e5-0f099e2549fa tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "DELETE /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 204 len: 0 microversion: 2.1 time: 0.166306 Jan 31 17:13:11.654450 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 425/936] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:13:11 2022] DELETE /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 17:13:11.666752 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:11.667884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:11.676623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:11.677392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:11.678320 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:11.678844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:11.877312 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:11.890238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-273686e1-82e4-450a-a864-a7b4bcdf8f98 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1513 microversion: 2.1 time: 0.228300 Jan 31 17:13:11.891522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 512/937] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:11 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:12.523592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:12.524727 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:12.532459 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:12.532923 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:12.533733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:12.534197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:12.634496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1057eac3-53b7-4227-922d-2b93a3be09b4 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce284d310>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:12.716643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1057eac3-53b7-4227-922d-2b93a3be09b4 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/a80bb9d8-8edd-4031-81be-b82f486c0200" status: 200 len: 350 microversion: 2.1 time: 0.086766 Jan 31 17:13:12.717224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 513/938] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:13:12 2022] GET /compute/v2.1/os-volumes/a80bb9d8-8edd-4031-81be-b82f486c0200 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:12.779708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:12.794326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ea0e00d2-72c4-4a97-85ea-2b13c7873a17 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.274855 Jan 31 17:13:12.795287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 426/939] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:12 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:12.920337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:12.921486 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:12.933332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:12.934148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:12.935609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:12.936488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:13.152061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:13.164329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c3348f28-574e-4961-92e3-88cfb7a56ef0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1513 microversion: 2.1 time: 0.250689 Jan 31 17:13:13.165324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 514/940] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:12 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:13.824453 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:13.825239 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:13.835202 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:13.835779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:13.836857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:13.837614 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:14.054238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:14.066446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e4ca1f5b-0703-4f8d-a0f1-986da7c627f7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.246943 Jan 31 17:13:14.067451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 427/941] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:13 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:14.191523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:14.192553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:14.204206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:14.204886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:14.206172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:14.206448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-56d86fac-92ed-466e-a5a2-f961207f6367 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce2729b80>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:14.207104 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:14.282274 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-56d86fac-92ed-466e-a5a2-f961207f6367 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/266b42f2-a8ce-4a5c-9887-f0f4cb014f73" status: 200 len: 350 microversion: 2.1 time: 0.082376 Jan 31 17:13:14.283398 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 428/942] 10.222.0.91 () {58 vars in 1244 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/os-volumes/266b42f2-a8ce-4a5c-9887-f0f4cb014f73 => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:14.302375 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9df7e186-870f-4ed3-b248-8a54d31ab1f8 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce26de5e0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:14.424436 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9df7e186-870f-4ed3-b248-8a54d31ab1f8 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.129175 Jan 31 17:13:14.425304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 429/943] 10.222.0.91 () {58 vars in 1133 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:14.431734 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:14.438833 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b9cb9975-0b21-45c9-bb2d-0bc330b2dd53 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce273f3a0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:14.445954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bd28d0fe-c1eb-4c00-b264-705cd2b88ce3 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1513 microversion: 2.1 time: 0.261713 Jan 31 17:13:14.447355 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 515/944] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:14.539371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b9cb9975-0b21-45c9-bb2d-0bc330b2dd53 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.105015 Jan 31 17:13:14.540044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 430/945] 10.222.0.91 () {58 vars in 1148 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:14.553261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c18009e7-7747-45b4-985a-180fca577dfc tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce27c9ca0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:14.638253 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c18009e7-7747-45b4-985a-180fca577dfc tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088872 Jan 31 17:13:14.638843 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 516/946] 10.222.0.91 () {58 vars in 1133 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:14.652542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-90699793-aedf-4db4-85f8-9ff2acbf1656 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce273f4c0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:14.943680 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-90699793-aedf-4db4-85f8-9ff2acbf1656 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.294775 Jan 31 17:13:14.944853 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 431/947] 10.222.0.91 () {58 vars in 1166 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:13:14.963313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c4010e1a-62bd-4751-b67b-e3370fde11b9 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce284d820>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:15.070934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c4010e1a-62bd-4751-b67b-e3370fde11b9 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.113561 Jan 31 17:13:15.071822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 517/948] 10.222.0.91 () {58 vars in 1169 bytes} [Mon Jan 31 17:13:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:15.087037 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:15.087681 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:15.092076 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e5f43ee6-7f4e-4a4e-9408-15966e58bb89 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce2739dc0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:15.095284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:15.096081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:15.097525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:15.098283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:15.198784 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e5f43ee6-7f4e-4a4e-9408-15966e58bb89 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.112762 Jan 31 17:13:15.199781 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 518/949] 10.222.0.91 () {58 vars in 1154 bytes} [Mon Jan 31 17:13:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:15.220449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8410bb00-b58d-41e9-958f-2fa1c80f6ef7 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce27ffdc0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:15.291096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:15.302750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0735ebb7-868c-46db-ab4a-20f4e803a9ea tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.220701 Jan 31 17:13:15.304483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 432/950] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:15 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:15.375563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8410bb00-b58d-41e9-958f-2fa1c80f6ef7 tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.163254 Jan 31 17:13:15.376831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 519/951] 10.222.0.91 () {58 vars in 1187 bytes} [Mon Jan 31 17:13:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:15.396023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-47aea7de-9810-4edf-8e0e-64d9a914b69e tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] Calling method '.version_select at 0x7fdce26de5e0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:15.474556 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:15.475526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:15.488187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-47aea7de-9810-4edf-8e0e-64d9a914b69e tempest-VolumesTestJSON-690214437 tempest-VolumesTestJSON-690214437-project] 10.222.0.91 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.099346 Jan 31 17:13:15.489502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:15.489648 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 433/952] 10.222.0.91 () {58 vars in 1154 bytes} [Mon Jan 31 17:13:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:15.489765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:15.491415 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:15.492260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:15.717656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:15.727836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-91958efa-caea-4469-8d7b-807e8b4b6c34 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1513 microversion: 2.1 time: 0.259176 Jan 31 17:13:15.728353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 520/953] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:15 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:16.329379 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:16.336723 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:16.353629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:16.354980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:16.356655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:16.357577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:16.558259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-8ec17efa-64ed-4bbf-8fd4-fc9196b186cd req-339024bf-522f-4e1b-a425-843f7f889b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecab8643-3faa-4e3e-88f2-8adfcb1c71a0", "name": "network-vif-deleted", "tag": "c048fe71-6e09-497a-bf75-3e88dc581cf2"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:16.562972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:13:16.562972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:13:16.576180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-8ec17efa-64ed-4bbf-8fd4-fc9196b186cd req-339024bf-522f-4e1b-a425-843f7f889b0e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:16.576831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-8ec17efa-64ed-4bbf-8fd4-fc9196b186cd req-339024bf-522f-4e1b-a425-843f7f889b0e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:16.599338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-8ec17efa-64ed-4bbf-8fd4-fc9196b186cd req-339024bf-522f-4e1b-a425-843f7f889b0e service nova] Creating event network-vif-deleted:c048fe71-6e09-497a-bf75-3e88dc581cf2 for instance ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 on hv-cinder-81566 Jan 31 17:13:16.605101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-8ec17efa-64ed-4bbf-8fd4-fc9196b186cd req-339024bf-522f-4e1b-a425-843f7f889b0e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062834 Jan 31 17:13:16.606342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 521/954] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:16.611520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:16.624178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c4c607df-32fd-4b7f-9d12-73a038bdde27 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.301923 Jan 31 17:13:16.625321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 434/955] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:16 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:16.751274 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:16.752628 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:16.764168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:16.765470 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:16.767105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:16.767916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:16.818871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:16.818871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:16.819195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lazy-loading 'fault' on Instance uuid ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:13:16.902413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:16.915484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6b78c18a-f368-4976-91a1-66293cb198b1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 200 len: 1309 microversion: 2.1 time: 0.172833 Jan 31 17:13:16.916178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 522/956] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:16 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 1309 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:17.655304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:17.656919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:17.668483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:17.669235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:17.671544 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:17.672792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:17.926219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:17.941064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3fcee33d-fa79-4fbf-b7db-5fdea2a285af tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.292304 Jan 31 17:13:17.943007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 435/957] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:17 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:17.949717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:17.952140 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: ecab8643-3faa-4e3e-88f2-8adfcb1c71a0] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:17.965546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:17.966618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:17.968969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:17.970189 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:18.002122 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] HTTP exception thrown: Instance ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 could not be found. Jan 31 17:13:18.003304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Returning 404 to user: Instance ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:13:18.005156 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-52c2b952-5a47-4836-8ef6-cddf90c98993 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0" status: 404 len: 111 microversion: 2.1 time: 0.063951 Jan 31 17:13:18.006524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 523/958] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:17 2022] GET /compute/v2.1/servers/ecab8643-3faa-4e3e-88f2-8adfcb1c71a0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:13:18.972953 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:18.974071 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:18.986716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:18.987482 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:18.989117 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:18.989870 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:19.192857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:19.207045 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-64922002-b4d2-4b92-abeb-91047c42e534 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.241153 Jan 31 17:13:19.207825 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 436/959] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:18 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:20.228516 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:20.230035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:20.243443 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:20.244475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:20.245851 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:20.246646 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:20.476171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:20.490069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-981cb88b-33f1-4dbe-8405-adadcfd6b717 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.267472 Jan 31 17:13:20.490960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 524/960] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:20 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:21.509315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:21.510023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:21.518181 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:21.518611 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:21.519420 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:21.519845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:21.731778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:21.743977 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-93081bfd-9e5d-4807-9bcc-ad8f4cb88cbb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.238141 Jan 31 17:13:21.745099 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 437/961] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:21 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:22.770911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:22.771954 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:22.784374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:22.785354 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:22.786763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:22.787664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:22.988711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:22.999852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-941d4af2-4ddd-4748-a40c-f4a0fa41b355 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.237268 Jan 31 17:13:23.000489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 525/962] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:22 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:24.033421 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:24.034032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:24.041539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:24.042315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:24.043690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:24.044632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:24.239262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:24.247894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6a2a2cca-12be-46d7-98b0-7b35588fae85 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.220905 Jan 31 17:13:24.248628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 438/963] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:24 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:25.272070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:25.272708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:25.280478 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:25.281115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:25.281911 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:25.282353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:25.456950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:25.465758 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b7d5080d-7113-4a7c-92a3-6ff285abc34e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.197402 Jan 31 17:13:25.466350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 526/964] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:25 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:26.487999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:26.489009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:26.500016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:26.500734 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:26.502169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:26.502963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:26.682489 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:26.691012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-950681b6-bcc3-4018-9d69-69251aec9730 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.208851 Jan 31 17:13:26.691613 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 439/965] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:26 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:27.713251 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:27.714297 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:27.724168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:27.724712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:27.725596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:27.726173 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:27.916234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:27.925567 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-94dcd3ac-8331-492c-9d0e-8d5a1525be6b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.219244 Jan 31 17:13:27.926161 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 527/966] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:27 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:28.944197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:28.945104 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:28.952294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:28.953086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:28.953893 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:28.954419 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:29.120362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:29.130747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-87ad6340-0954-410c-b2e1-835c94bb52a7 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.191216 Jan 31 17:13:29.131341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 440/967] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:28 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:29.375594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1010230310", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "networks": [{"uuid": "31a980c3-946a-4acb-bd5e-eceadd945147"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:29.455056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] validate_networks() for [('31a980c3-946a-4acb-bd5e-eceadd945147', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:13:30.129262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:13:30.129725 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:13:30.130206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:13:30.130625 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:13:30.131046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:13:30.143015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:30.143594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:30.144723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:30.145353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:30.153059 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:30.155060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:30.162526 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:30.163003 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:30.163860 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:30.164346 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:30.165395 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Getting quotas for project 5e68191762cc4f148363bbe05beac72c. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:13:30.172301 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Getting quotas for user 626459efa95b420a8e1f473e2dfdd7df and project 5e68191762cc4f148363bbe05beac72c. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:13:30.203802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:13:30.206262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:13:30.273402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-783b8d06-bf2d-45be-b82a-6787149b8749 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902701 Jan 31 17:13:30.274168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 528/968] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:13:30.284969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5fd6e534-bccb-44c1-9d78-c90dbb7b72ed tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:30.285596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5fd6e534-bccb-44c1-9d78-c90dbb7b72ed tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:30.420075 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5fd6e534-bccb-44c1-9d78-c90dbb7b72ed tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:30.439618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5fd6e534-bccb-44c1-9d78-c90dbb7b72ed tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1219 microversion: 2.1 time: 0.158039 Jan 31 17:13:30.440418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 529/969] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:30 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1219 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:30.461866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:30.476835 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c146e438-fcaf-483d-8f74-ed917c62aa80 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.330221 Jan 31 17:13:30.477648 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 441/970] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:30 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:31.467045 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:31.468724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:31.481617 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:31.482420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:31.483974 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:31.484825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:31.503795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:31.504970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:31.515051 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:31.515851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:31.517361 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:31.518139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:31.585708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:31.598717 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d67f6877-4cdf-4cda-852f-6bb65f310104 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1223 microversion: 2.1 time: 0.136014 Jan 31 17:13:31.599468 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 530/971] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:31 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:31.730892 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:31.742629 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a9f3c3e1-890e-4472-bd37-c952df3bf226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.246010 Jan 31 17:13:31.743475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 442/972] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:31 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:32.627137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:32.631747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:32.648942 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:32.649795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:32.651610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:32.652447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:32.752268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:32.761957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bb37365f-e153-4872-b6a8-9fa8a185f7da tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1223 microversion: 2.1 time: 0.146110 Jan 31 17:13:32.762737 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 531/973] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:32 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:32.776596 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:32.777912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:32.790364 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:32.791172 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:32.792275 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:32.792801 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:32.999595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:33.012832 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e74ae04b-b669-4338-b81c-bce209a22547 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1676 microversion: 2.1 time: 0.244492 Jan 31 17:13:33.014599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 443/974] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:32 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1676 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:33.786576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:33.787360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:33.797473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:33.798270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:33.799442 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:33.800036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:33.919746 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:33.938761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5b1fa594-df3b-472d-9d4a-24fc07d0d7b0 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1279 microversion: 2.1 time: 0.161196 Jan 31 17:13:33.940748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 532/975] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:33 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:34.036689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:34.037746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:34.050270 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.051524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:34.053591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.054702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:34.304401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:34.339304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-925dc722-4c8f-4aff-9f15-445d944419fb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1653 microversion: 2.1 time: 0.309983 Jan 31 17:13:34.340937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 444/976] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:34 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1653 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:34.366520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-af247d91-b084-415f-a371-525ea729dfc0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:34.376683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-af247d91-b084-415f-a371-525ea729dfc0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.377364 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-af247d91-b084-415f-a371-525ea729dfc0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:34.430396 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-af247d91-b084-415f-a371-525ea729dfc0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Going to try to start instance {{(pid=116483) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 31 17:13:34.505690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-af247d91-b084-415f-a371-525ea729dfc0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action" status: 202 len: 0 microversion: 2.1 time: 0.147500 Jan 31 17:13:34.506707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 533/977] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:13:34 2022] POST /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:13:34.518946 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:34.520748 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:34.532929 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.533612 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:34.534718 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.535267 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:34.790691 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:34.800505 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-02130fde-6382-475f-9828-06696562d3a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1662 microversion: 2.1 time: 0.288308 Jan 31 17:13:34.801412 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 445/978] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:34 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1662 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:34.965335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:34.970648 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:34.982484 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.983685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:34.984626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:34.985700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:35.262761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:35.274121 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ba384ec9-1d73-49d6-a8b9-8bf4f84ac701 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.316657 Jan 31 17:13:35.275184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 534/979] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:34 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:35.829135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:35.829914 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:35.837483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:35.838606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:35.838606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:35.839029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:35.983534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-55f9e95d-c476-4a15-a965-b820854f2de5 req-2aa7f52b-8c6d-4a4a-bfcb-c93ff38b9e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ffe4abd-76c2-498d-af17-45765702ab49", "tag": "f2b9572d-dc61-445b-99bd-f7d1bc3d3e3e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:35.998234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:13:35.998234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:13:36.015537 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-55f9e95d-c476-4a15-a965-b820854f2de5 req-2aa7f52b-8c6d-4a4a-bfcb-c93ff38b9e25 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:36.016477 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-55f9e95d-c476-4a15-a965-b820854f2de5 req-2aa7f52b-8c6d-4a4a-bfcb-c93ff38b9e25 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:36.038678 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-55f9e95d-c476-4a15-a965-b820854f2de5 req-2aa7f52b-8c6d-4a4a-bfcb-c93ff38b9e25 service nova] Creating event network-changed:f2b9572d-dc61-445b-99bd-f7d1bc3d3e3e for instance 6ffe4abd-76c2-498d-af17-45765702ab49 on hv-cinder-81566 Jan 31 17:13:36.049938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-55f9e95d-c476-4a15-a965-b820854f2de5 req-2aa7f52b-8c6d-4a4a-bfcb-c93ff38b9e25 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071896 Jan 31 17:13:36.051698 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 535/980] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:36.053372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:36.068377 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4300e864-9ae4-4e04-9598-2e415ec5ffbe tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1662 microversion: 2.1 time: 0.245797 Jan 31 17:13:36.069434 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 446/981] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:35 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1662 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:36.301944 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:36.303186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:36.324147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:36.324620 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:36.325634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:36.325862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:36.508497 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:36.517236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-31e30d58-8549-49b1-a504-cb9fef38db78 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.222288 Jan 31 17:13:36.517829 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 536/982] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:36 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:37.093208 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:37.095556 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:37.107483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:37.108850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:37.110095 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:37.110765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:37.345351 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:37.360740 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cf0c2b50-d60e-4c57-b1fd-79526394fa1c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1666 microversion: 2.1 time: 0.274679 Jan 31 17:13:37.361821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 447/983] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:37 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1666 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:37.547490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:37.548643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:37.559866 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:37.560587 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:37.563036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:37.563777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:37.828818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:37.840178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-58e43cec-0c8a-4747-999b-cf66dedc9ca6 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.300381 Jan 31 17:13:37.851500 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 537/984] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:37 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:38.860806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:38.862299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:38.875601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:38.876429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:38.877886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:38.878666 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:39.101978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:39.115210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5975e80e-27f1-41a1-9cff-1890d21b8194 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.258757 Jan 31 17:13:39.115879 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 448/985] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:38 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:40.134675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:40.135473 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:40.144223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:40.144699 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:40.145520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:40.145968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:40.336986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:40.353875 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-87053add-d4d3-4dfb-a49a-053cecd3e7de tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.222926 Jan 31 17:13:40.355914 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 538/986] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:40 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:41.373839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:41.374591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:41.383268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:41.383999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:41.387208 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:41.387208 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:41.573075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:41.584251 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b7fb1cbd-f660-4e39-acc5-a25ef5fb2c91 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.214220 Jan 31 17:13:41.584747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 449/987] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:41 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:42.606712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:42.607356 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:42.629900 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:42.631946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:42.633902 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:42.634895 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:42.839072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:42.848458 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0725cede-8a76-4604-85bb-c9afa820108e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.246692 Jan 31 17:13:42.849066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 539/988] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:42 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:43.871984 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:43.874036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:43.891534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:43.891988 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:43.892992 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:43.893826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:44.139535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:44.155963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dd8d932e-85e0-4f36-a6a8-8003f56fce2e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.289732 Jan 31 17:13:44.157140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 450/989] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:43 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:44.507668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-9613c1a7-4649-49cf-85f2-453de92f8587 req-61fce2b5-917a-4f0e-a295-d7bcc8441d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffe4abd-76c2-498d-af17-45765702ab49", "name": "network-vif-plugged", "status": "completed", "tag": "f2b9572d-dc61-445b-99bd-f7d1bc3d3e3e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:44.509498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:13:44.509498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:13:44.518862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-9613c1a7-4649-49cf-85f2-453de92f8587 req-61fce2b5-917a-4f0e-a295-d7bcc8441d06 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:44.519526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-9613c1a7-4649-49cf-85f2-453de92f8587 req-61fce2b5-917a-4f0e-a295-d7bcc8441d06 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:44.537743 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-9613c1a7-4649-49cf-85f2-453de92f8587 req-61fce2b5-917a-4f0e-a295-d7bcc8441d06 service nova] Creating event network-vif-plugged:f2b9572d-dc61-445b-99bd-f7d1bc3d3e3e for instance 6ffe4abd-76c2-498d-af17-45765702ab49 on hv-cinder-81566 Jan 31 17:13:44.545818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-9613c1a7-4649-49cf-85f2-453de92f8587 req-61fce2b5-917a-4f0e-a295-d7bcc8441d06 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041312 Jan 31 17:13:44.546769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 540/990] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:45.184312 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:45.186201 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:45.195464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:45.195999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:45.197076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:45.197586 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:45.399080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:45.408266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-eea43efd-c6cf-4857-a691-2fe357f11da1 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.230541 Jan 31 17:13:45.409236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 451/991] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:45 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:46.429243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:46.430114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:46.437792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:46.438278 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:46.439600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:46.440054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:46.613907 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:46.629750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b966bbc8-9eb0-4272-8da0-d6622680d84c tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1319 microversion: 2.1 time: 0.205767 Jan 31 17:13:46.630833 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 541/992] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:46 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:47.656864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:47.657559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:47.664713 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:47.665166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:47.665986 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:47.666431 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:47.853885 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:47.865942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-553e4a75-7708-416f-9507-cfefb00c24fb tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1507 microversion: 2.1 time: 0.215034 Jan 31 17:13:47.866543 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 452/993] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:47 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:47.888157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cf0bc80-2fe0-4f31-a4f1-ea1856a1c099", "device": "/dev/sdb"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:47.892091 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:47.904822 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:47.905371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:47.906358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:47.906825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:48.305357 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bde33512-54c2-4995-a7ac-e638e8282546 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "POST /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423489 Jan 31 17:13:48.306241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 542/994] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:13:47 2022] POST /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:13:54.305102 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:13:54.309052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:54.320557 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:54.321698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:54.323062 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:54.324304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:54.481593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7f339e4c-2e7c-4a6c-b7e5-95794086e868 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/action" status: 202 len: 0 microversion: 2.1 time: 0.180624 Jan 31 17:13:54.484910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 453/995] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:13:54 2022] POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:13:54.506478 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:54.516366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:54.542495 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:54.543172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:54.543946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:54.545401 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:54.834604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:54.849832 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e49c3707-aa3a-4ef5-b66e-819caa4577af tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1751 microversion: 2.1 time: 0.356886 Jan 31 17:13:54.850677 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 543/996] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:54 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1751 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:55.875678 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:55.877417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:55.884211 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:55.884684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:55.885528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:55.885979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:56.168520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:56.180674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-eef9d097-fdc1-462a-b9f5-43a8389a9d11 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.310144 Jan 31 17:13:56.181602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 454/997] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:55 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:57.208740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:57.209729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:57.221530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:57.222166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:57.223514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:57.224264 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:57.511399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:57.525735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8f7e270c-3806-4869-9e1d-f170294ad317 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.325783 Jan 31 17:13:57.526805 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 544/998] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:57 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:13:58.548836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:58.549560 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:58.558697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:58.559382 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:58.560893 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:58.561729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:58.780161 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:13:58.789455 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-20a295de-df05-4a1a-a8b6-be353167d0a5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.246269 Jan 31 17:13:58.790550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 455/999] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:58 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:13:59.821860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:13:59.822945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:13:59.835546 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:59.836405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:13:59.837971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:13:59.838702 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:00.080276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:00.094206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6efb2af0-31a8-4609-8a30-9976236ee7f1 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.279293 Jan 31 17:14:00.094971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 545/1000] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:13:59 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:14:01.115755 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:01.116871 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:01.130399 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:01.130969 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:01.131886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:01.132516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:01.348617 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:01.360470 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-269ee2a2-bdd9-4ccf-81e0-eab12e26bdb9 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.251060 Jan 31 17:14:01.361142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 456/1001] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:01 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:02.386305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:02.387009 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:02.399100 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:02.399940 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:02.401257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:02.401257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:02.680060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:02.701499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-210215fb-2563-47ac-b2b5-ba403689fe04 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.318192 Jan 31 17:14:02.703432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 546/1002] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:02 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:03.730077 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:03.731139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:03.741882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:03.742698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:03.744485 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:03.745312 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:03.992029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:04.008532 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6171ce8a-f845-41d4-8819-0887d9656a38 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.284614 Jan 31 17:14:04.009615 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 457/1003] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:03 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:05.034239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:05.035071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:05.045564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:05.046344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:05.047862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:05.048707 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:05.246633 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:05.256035 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cc9428a6-bdd9-43f7-9f0f-fecf313c9a71 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.227983 Jan 31 17:14:05.256608 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 547/1004] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:05 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:06.274663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:06.275540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:06.283048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:06.283515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:06.284358 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:06.284806 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:06.467209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:06.482419 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f73a4bbc-61c6-45f1-91c6-25a73653b7b2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.210782 Jan 31 17:14:06.483655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 458/1005] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:06 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:07.506937 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:07.507854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:07.523931 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:07.524558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:07.525475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:07.526040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:07.774875 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:07.788512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c4ef6ca0-ccb9-46aa-bd50-b5beb2f849d2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.285248 Jan 31 17:14:07.789548 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 548/1006] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:07 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:14:08.410708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:14:08.410708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: Mon Jan 31 17:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:14:08.818384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:08.820495 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:08.833391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:08.833988 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:08.834909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:08.835469 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:09.048672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:09.056933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-62beb1e7-cd14-4dbd-965a-c8d69ae72c68 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.248161 Jan 31 17:14:09.057528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 459/1007] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:08 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:10.083589 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:10.084569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:10.092152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:10.092645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:10.093531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:10.093972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:10.356814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:10.379430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-67c0696b-d480-43a6-96c2-779df0a42cc0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.299663 Jan 31 17:14:10.380496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 549/1008] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:10 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:10.550628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:10.551459 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:10.561632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:10.562278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:10.563586 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:10.564169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:10.665209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lazy-loading 'services' on Instance uuid 6ffe4abd-76c2-498d-af17-45765702ab49 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:14:10.802954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c4775e28-9b6c-4986-9365-a9fea3a05232 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49/os-volume_attachments/1cf0bc80-2fe0-4f31-a4f1-ea1856a1c099" status: 202 len: 0 microversion: 2.1 time: 0.259226 Jan 31 17:14:10.804458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 460/1009] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:14:10 2022] DELETE /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49/os-volume_attachments/1cf0bc80-2fe0-4f31-a4f1-ea1856a1c099 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:14:11.410145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:11.411223 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:11.424574 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:11.425337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:11.426726 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:11.427597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:12.083444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:12.096760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-07a57c29-ed22-4d18-94e1-5eaff6349090 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.693899 Jan 31 17:14:12.097776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 550/1010] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:11 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:13.122661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:13.123897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:13.129683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:13.134954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:13.135258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:13.135770 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:13.138250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:13.138993 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:13.149576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:13.150035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:13.150854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:13.151304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:13.221390 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:14:13.385033 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f320eb9f-6602-490e-a42f-2646c40bf218 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 204 len: 0 microversion: 2.1 time: 0.273431 Jan 31 17:14:13.386114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 461/1011] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:14:13 2022] DELETE /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:14:13.398826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:13.400517 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:13.409962 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:13.411242 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:13.411757 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:13.412474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:13.413446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:13.425635 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a8e04616-dbbf-4067-a85b-fc5c0a691d06 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.311051 Jan 31 17:14:13.426876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 551/1012] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:13 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:13.660829 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:13.682017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6fc55be3-e4da-422d-a401-70a65e1b65c9 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1513 microversion: 2.1 time: 0.288325 Jan 31 17:14:13.684771 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 462/1013] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:13 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:14:14.455111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:14.455982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:14.467147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:14.467669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:14.468813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:14.469343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:14.709963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:14.713730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:14.715890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:14.725993 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-49d376a6-e5f2-4096-8582-80132d1d932f tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.277066 Jan 31 17:14:14.727206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 552/1014] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:14 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:14.729034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:14.729818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:14.733633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:14.733633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:14.940368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:14.953236 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-175a4a62-6ee9-4359-83d4-37ec8d04eb94 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1513 microversion: 2.1 time: 0.248013 Jan 31 17:14:14.954306 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 463/1015] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:14 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:15.756812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:15.757456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:15.766516 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:15.767201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:15.768687 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:15.769395 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:15.987097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:15.988343 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:16.005876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:16.007756 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:16.008298 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:16.009673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:16.010304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:16.028493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-43cbb11d-7408-4546-965f-cd6005d1d697 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.276230 Jan 31 17:14:16.029653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 553/1016] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:15 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:16.267259 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:16.285088 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5b299ea5-8f0d-49db-a980-76900f4b5245 tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1513 microversion: 2.1 time: 0.308498 Jan 31 17:14:16.286015 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 464/1017] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:15 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:17.063260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:17.064555 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:17.075092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:17.075930 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:17.077108 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:17.077837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:17.313528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:17.315764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:17.333326 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:17.335641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:17.338734 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:17.339886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:17.381786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:17.402448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-37295e57-b716-4f06-8006-2c1399526688 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1756 microversion: 2.1 time: 0.346847 Jan 31 17:14:17.404080 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 554/1018] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:17 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1756 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:17.630360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:17.645674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ff95035d-e8b5-47ad-b236-8d93f8f6735b tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1513 microversion: 2.1 time: 0.340512 Jan 31 17:14:17.647150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 465/1019] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:17 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:14:18.007654 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-0853595f-b32f-428b-a690-02828e0ed183 req-7a864d62-8ea0-4f4f-80b9-5d0edc6bbf0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ffe4abd-76c2-498d-af17-45765702ab49", "name": "network-vif-deleted", "tag": "f2b9572d-dc61-445b-99bd-f7d1bc3d3e3e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:18.012201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:14:18.012201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:14:18.026730 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-0853595f-b32f-428b-a690-02828e0ed183 req-7a864d62-8ea0-4f4f-80b9-5d0edc6bbf0b service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:18.027617 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-0853595f-b32f-428b-a690-02828e0ed183 req-7a864d62-8ea0-4f4f-80b9-5d0edc6bbf0b service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:18.049958 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-0853595f-b32f-428b-a690-02828e0ed183 req-7a864d62-8ea0-4f4f-80b9-5d0edc6bbf0b service nova] Creating event network-vif-deleted:f2b9572d-dc61-445b-99bd-f7d1bc3d3e3e for instance 6ffe4abd-76c2-498d-af17-45765702ab49 on hv-cinder-81566 Jan 31 17:14:18.060560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-0853595f-b32f-428b-a690-02828e0ed183 req-7a864d62-8ea0-4f4f-80b9-5d0edc6bbf0b service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062524 Jan 31 17:14:18.061504 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 555/1020] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:14:18.436300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:18.437270 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:18.447524 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:18.448069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:18.448881 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:18.449371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:18.673115 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:18.675994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:18.693840 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:18.695213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:18.697084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:18.698092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:18.725383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:18.763381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3e026f5c-beb9-408f-8b32-fa1177330c1e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1759 microversion: 2.1 time: 0.335130 Jan 31 17:14:18.765226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 466/1021] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:18 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1759 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:18.768097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:18.769257 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:18.770192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lazy-loading 'fault' on Instance uuid 6ffe4abd-76c2-498d-af17-45765702ab49 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:14:18.860215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626459efa95b420a8e1f473e2dfdd7df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e68191762cc4f148363bbe05beac72c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:18.871776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d1e569d2-4d4f-49f7-8637-6cdddc6e062e tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 200 len: 1309 microversion: 2.1 time: 0.207730 Jan 31 17:14:18.872956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 556/1022] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:18 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 1309 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:19.905362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:19.906444 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] [instance: 6ffe4abd-76c2-498d-af17-45765702ab49] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:19.915490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:19.916697 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:19.918164 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:19.919369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:19.947107 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] HTTP exception thrown: Instance 6ffe4abd-76c2-498d-af17-45765702ab49 could not be found. Jan 31 17:14:19.948563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] Returning 404 to user: Instance 6ffe4abd-76c2-498d-af17-45765702ab49 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:14:19.950575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:19.951273 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-64064db3-620d-45c5-95d7-3e1cc20234ea tempest-VolumesSnapshotTestJSON-262270549 tempest-VolumesSnapshotTestJSON-262270549-project] 10.222.0.91 "GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49" status: 404 len: 111 microversion: 2.1 time: 0.051313 Jan 31 17:14:19.957409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 467/1023] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:19 2022] GET /compute/v2.1/servers/6ffe4abd-76c2-498d-af17-45765702ab49 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:14:19.959949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:19.975650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:19.976495 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:19.977796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:19.984945 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:20.076858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-021f2b31-0e0b-40fb-a61d-28031daed4df tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments/2c10719a-322d-4a42-84e4-62407fd13d06" status: 200 len: 194 microversion: 2.20 time: 0.134926 Jan 31 17:14:20.079743 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 557/1024] 10.222.0.91 () {60 vars in 1453 bytes} [Mon Jan 31 17:14:19 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments/2c10719a-322d-4a42-84e4-62407fd13d06 => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:14:20.196028 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:20.197550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:20.209028 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:20.209707 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:20.210797 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:20.211591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:20.418233 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lazy-loading 'services' on Instance uuid 7c80add9-d970-4aae-9ab5-6df59903b074 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:14:20.583581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a10a2607-e116-4c63-9551-3467178f4981 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments/2c10719a-322d-4a42-84e4-62407fd13d06" status: 202 len: 0 microversion: 2.20 time: 0.391908 Jan 31 17:14:20.585170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 468/1025] 10.222.0.91 () {60 vars in 1456 bytes} [Mon Jan 31 17:14:20 2022] DELETE /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments/2c10719a-322d-4a42-84e4-62407fd13d06 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:14:20.599417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:20.600916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:20.612939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:20.613322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:20.614148 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:20.614719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:20.671594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2b81b5e4-c1e0-4deb-89c7-7ee21665a418 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078417 Jan 31 17:14:20.673025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 558/1026] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Jan 31 17:14:20 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:14:21.692974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:21.694725 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:21.706189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:21.707328 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:21.709035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:21.709943 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:21.770272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-df1d4d67-55ed-402f-814b-e00b5a00a47f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086797 Jan 31 17:14:21.771402 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 469/1027] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Jan 31 17:14:21 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:14:22.794036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:22.795938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:22.809657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:22.810048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:22.811559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:22.812428 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:22.885428 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b3e9ce5c-ec15-409e-8a94-e88a4509800c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.099848 Jan 31 17:14:22.886630 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 559/1028] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Jan 31 17:14:22 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:22.970605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:22.971407 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:22.982439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:22.983250 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:22.984696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:22.985484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:23.041738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:14:23.218738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7ef622d8-517e-4c1a-93a5-64d0aad928f2 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 204 len: 0 microversion: 2.20 time: 0.251277 Jan 31 17:14:23.220790 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 470/1029] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Jan 31 17:14:22 2022] DELETE /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 31 17:14:23.235903 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:23.237513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:23.255050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:23.255931 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:23.261728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:23.263323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:23.592963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:23.608130 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:23.611811 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:23.615054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9e1cfe57-b732-4f70-b471-1ed1b860e6d4 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.386313 Jan 31 17:14:23.615054 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 560/1030] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:23 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:24.651514 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:24.651514 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:24.663300 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:24.663908 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:24.665382 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:24.666462 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:25.005581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:25.023530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:25.026652 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:25.029843 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8d1d07b7-a4d5-42cf-8c5a-5b7e467d3094 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.388605 Jan 31 17:14:25.030731 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 471/1031] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:24 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:26.062328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:26.063590 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:26.099887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:26.100811 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:26.102724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:26.103553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:26.422860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:26.430749 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:26.433138 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:26.436718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-03cbebfe-06a6-4355-a715-ac309755b79d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.382921 Jan 31 17:14:26.437541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 561/1032] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:26 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:27.463849 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:27.464883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:27.477287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:27.478137 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:27.479672 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:27.480549 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:27.756075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:27.777032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:27.780397 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:27.783682 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bc701b60-3c55-4e5d-a904-a0633f9fb728 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1723 microversion: 2.20 time: 0.324771 Jan 31 17:14:27.785238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 472/1033] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:27 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:28.817819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:28.819032 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:28.830231 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:28.831010 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:28.832456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:28.833217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:28.938466 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:28.958747 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:28.962491 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:28.965455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-af48370a-2941-4725-b42c-2a1999caf5a8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1656 microversion: 2.20 time: 0.153959 Jan 31 17:14:28.972290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 562/1034] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:28 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:29.753203 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-2db7ae37-b188-4eec-849c-bb2cdea60d6a req-98661df8-9265-46af-9c04-4fe326b7f288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c80add9-d970-4aae-9ab5-6df59903b074", "name": "network-vif-deleted", "tag": "bc1a97be-883f-4758-9789-57b06d0ec3fc"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:29.754965 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:14:29.754965 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:14:29.770012 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-2db7ae37-b188-4eec-849c-bb2cdea60d6a req-98661df8-9265-46af-9c04-4fe326b7f288 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:29.770554 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-2db7ae37-b188-4eec-849c-bb2cdea60d6a req-98661df8-9265-46af-9c04-4fe326b7f288 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:29.791752 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-2db7ae37-b188-4eec-849c-bb2cdea60d6a req-98661df8-9265-46af-9c04-4fe326b7f288 service nova] Creating event network-vif-deleted:bc1a97be-883f-4758-9789-57b06d0ec3fc for instance 7c80add9-d970-4aae-9ab5-6df59903b074 on hv-cinder-81566 Jan 31 17:14:29.802854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-2db7ae37-b188-4eec-849c-bb2cdea60d6a req-98661df8-9265-46af-9c04-4fe326b7f288 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055135 Jan 31 17:14:29.804345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 473/1035] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:14:29.991552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:29.994220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:30.007668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:30.008792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:30.010563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:30.011634 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:30.069876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:30.070576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:30.071218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lazy-loading 'fault' on Instance uuid 7c80add9-d970-4aae-9ab5-6df59903b074 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:14:30.144033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:30.157070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:30.160716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:30.162540 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-31272ff6-3b4d-4fe7-b9ea-1a4d3ff273be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 200 len: 1370 microversion: 2.20 time: 0.176905 Jan 31 17:14:30.163570 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 563/1036] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:29 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:14:31.196545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:31.197502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:31.223414 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:31.224322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:31.225765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:31.226528 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:31.254809 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] HTTP exception thrown: Instance 7c80add9-d970-4aae-9ab5-6df59903b074 could not be found. Jan 31 17:14:31.255745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Returning 404 to user: Instance 7c80add9-d970-4aae-9ab5-6df59903b074 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:14:31.257232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-249de2c1-5df4-403f-af6f-b5b4975503f0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 404 len: 111 microversion: 2.20 time: 0.069362 Jan 31 17:14:31.263550 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 474/1037] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:31 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:14:31.272916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6b1945fc-6c80-449a-bb0a-d0bc59c21ccb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '.version_select at 0x7fdce2842ca0>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:31.328640 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6b1945fc-6c80-449a-bb0a-d0bc59c21ccb tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592047010" status: 204 len: 0 microversion: 2.20 time: 0.060825 Jan 31 17:14:31.330890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 564/1038] 10.222.0.91 () {60 vars in 1258 bytes} [Mon Jan 31 17:14:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592047010 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 31 17:14:32.666654 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fadaca2c-2abd-4650-afcc-9de15f599f68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'create', calling method: .version_select at 0x7fdce274dd30>, body: {"keypair": {"name": "tempest-keypair-660067138"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:32.733240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-fadaca2c-2abd-4650-afcc-9de15f599f68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:14:32.739910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-fadaca2c-2abd-4650-afcc-9de15f599f68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for user 2cae436f97f74de1bebd6c763867bfa0 and project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:14:32.971455 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-fadaca2c-2abd-4650-afcc-9de15f599f68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:14:32.978113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-fadaca2c-2abd-4650-afcc-9de15f599f68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for user 2cae436f97f74de1bebd6c763867bfa0 and project cef2ba1be78a47e4b1e70224544c7828. Resources: {'key_pairs'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:14:32.994645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fadaca2c-2abd-4650-afcc-9de15f599f68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.345813 Jan 31 17:14:32.995284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 475/1039] 10.222.0.91 () {62 vars in 1198 bytes} [Mon Jan 31 17:14:32 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 348 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 31 17:14:35.177392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-635555186", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cee72dd-bdc6-4eeb-b5e0-7fb5d5eec549"}], "security_groups": [{"name": "tempest-securitygroup--1680689410"}], "key_name": "tempest-keypair-660067138", "user_data": "}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:35.325824 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] validate_networks() for [('8cee72dd-bdc6-4eeb-b5e0-7fb5d5eec549', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:14:35.852814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:14:35.853736 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:14:35.854784 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:14:35.856147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:14:35.856675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:14:35.872889 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:35.873521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:35.874677 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:35.875142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:35.899432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for project cef2ba1be78a47e4b1e70224544c7828. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:14:35.908519 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Getting quotas for user 2cae436f97f74de1bebd6c763867bfa0 and project cef2ba1be78a47e4b1e70224544c7828. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:14:35.927563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:14:35.931778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:14:36.016207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-313ad0bd-bad5-4d84-80ea-3e0d11e0c9ea tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.844414 Jan 31 17:14:36.018002 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 565/1040] 10.222.0.91 () {62 vars in 1187 bytes} [Mon Jan 31 17:14:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 31 17:14:36.033918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4b5f913c-1579-4f83-b1a8-5be6c5d6b4e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:36.034942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4b5f913c-1579-4f83-b1a8-5be6c5d6b4e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:36.120296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4b5f913c-1579-4f83-b1a8-5be6c5d6b4e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:36.131023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4b5f913c-1579-4f83-b1a8-5be6c5d6b4e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:36.132690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4b5f913c-1579-4f83-b1a8-5be6c5d6b4e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:36.133937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4b5f913c-1579-4f83-b1a8-5be6c5d6b4e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1280 microversion: 2.20 time: 0.106122 Jan 31 17:14:36.142959 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 476/1041] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:36 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:37.156489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:37.157265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:37.165887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:37.166447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:37.167280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:37.168067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:37.265256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:37.276529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:37.279186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:37.280852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-163c0a9a-950d-49d6-bccc-f5e59e75a24c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1332 microversion: 2.20 time: 0.130442 Jan 31 17:14:37.281612 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 566/1042] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:37 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:38.310721 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:38.314929 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:38.335998 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:38.337395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:38.339741 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:38.340432 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:38.429070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:38.443982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:38.447456 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:38.450811 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4c9d8aec-3989-4009-a84a-1026eccb4295 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1338 microversion: 2.20 time: 0.148249 Jan 31 17:14:38.452223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 477/1043] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:38 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:39.475594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:39.477645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:39.492638 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:39.493834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:39.496784 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:39.498708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:39.827162 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:39.843584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:39.846342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:39.848861 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3e00a72b-bdb2-4b07-a2fe-0536f04a34a3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.379230 Jan 31 17:14:39.849854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 567/1044] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:39 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:39.908386 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-7be2ffc1-51b6-4f6c-8a31-ebe78a33da88 req-430b7ae5-d555-4cf7-9947-7f904d692c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:39.909471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:14:39.909471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:14:39.923842 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-7be2ffc1-51b6-4f6c-8a31-ebe78a33da88 req-430b7ae5-d555-4cf7-9947-7f904d692c0f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:39.924770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-7be2ffc1-51b6-4f6c-8a31-ebe78a33da88 req-430b7ae5-d555-4cf7-9947-7f904d692c0f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:39.958912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-7be2ffc1-51b6-4f6c-8a31-ebe78a33da88 req-430b7ae5-d555-4cf7-9947-7f904d692c0f service nova] Creating event network-changed:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:14:39.966127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-7be2ffc1-51b6-4f6c-8a31-ebe78a33da88 req-430b7ae5-d555-4cf7-9947-7f904d692c0f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066156 Jan 31 17:14:39.966751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 478/1045] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:14:40.125733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:40.127146 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:40.138124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.138790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.140214 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.140875 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.192663 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6e5ce517-3125-484a-acb7-f07805268010 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074445 Jan 31 17:14:40.193479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 568/1046] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:14:40 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:14:40.277140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:40.278277 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:40.286954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.287412 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.288328 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.288945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.358889 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:14:40.510851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-547c5aba-4a2a-4b28-98b5-96bfbbd599a9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 204 len: 0 microversion: 2.1 time: 0.240268 Jan 31 17:14:40.512191 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 479/1047] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:14:40 2022] DELETE /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 31 17:14:40.524426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:40.525310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:40.532941 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.533553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.534465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.535178 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.827728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:40.856260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9dc0f88b-7015-4756-b183-888a94946c71 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1672 microversion: 2.1 time: 0.336957 Jan 31 17:14:40.857244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 569/1048] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:40 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1672 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:40.879210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:40.880502 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:40.890537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.891353 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:40.892741 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:40.893477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:41.119978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:41.130321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:41.131878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:41.133076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b64a7c72-a8d6-4621-952f-4aca82a79387 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.262202 Jan 31 17:14:41.133655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 480/1049] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:40 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:41.882260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:41.883464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:41.895324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:41.896135 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:41.897819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:41.898583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:42.133756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:42.143354 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9932c251-5dd7-4be6-b06a-b87c632c9f33 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1672 microversion: 2.1 time: 0.268034 Jan 31 17:14:42.144011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 570/1050] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:41 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1672 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:42.158599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:42.160008 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:42.171138 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:42.171789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:42.172620 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:42.173129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:42.404230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:42.420866 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:42.424340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:42.426515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-7331cec3-29db-4158-be11-fefcca497aed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.271333 Jan 31 17:14:42.427189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 481/1051] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:42 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:43.183542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:43.185793 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:43.196642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:43.197227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:43.198277 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:43.198882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:43.397623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:43.412132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-99ddf6e3-a844-46fb-95ac-dfa7cdd86527 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1672 microversion: 2.1 time: 0.235797 Jan 31 17:14:43.413282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 571/1052] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:43 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:43.457698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:43.458825 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:43.472198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:43.473032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:43.474464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:43.475273 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:43.714994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:43.742916 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:43.746768 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:43.749814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-92303ee5-232c-4e74-884c-faf6f0c0a4d0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.298926 Jan 31 17:14:43.750957 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 482/1053] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:43 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:14:44.194482 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-f2e61dfd-62c4-4d7f-a38c-7a36bce5b8ae req-8dc3ea1c-1e69-45db-a3f2-e1239681baea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578b3d82-02e9-4759-b0e3-ad4ff650a4c4", "name": "network-vif-deleted", "tag": "e6a7874f-beac-4e94-88c7-ad9d8063cb4a"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:44.202125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:14:44.202125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:14:44.223472 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f2e61dfd-62c4-4d7f-a38c-7a36bce5b8ae req-8dc3ea1c-1e69-45db-a3f2-e1239681baea service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:44.224290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f2e61dfd-62c4-4d7f-a38c-7a36bce5b8ae req-8dc3ea1c-1e69-45db-a3f2-e1239681baea service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:44.257184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-f2e61dfd-62c4-4d7f-a38c-7a36bce5b8ae req-8dc3ea1c-1e69-45db-a3f2-e1239681baea service nova] Creating event network-vif-deleted:e6a7874f-beac-4e94-88c7-ad9d8063cb4a for instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 on hv-cinder-81566 Jan 31 17:14:44.267978 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-f2e61dfd-62c4-4d7f-a38c-7a36bce5b8ae req-8dc3ea1c-1e69-45db-a3f2-e1239681baea service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091337 Jan 31 17:14:44.270181 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 572/1054] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:14:44.440704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:44.443389 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:44.458439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:44.463406 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:44.467184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:44.468465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:44.579779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:44.580347 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:44.580815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lazy-loading 'fault' on Instance uuid 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:14:44.716707 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:44.739898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d7073b22-d093-4a18-8985-a8e9deeef936 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 200 len: 1328 microversion: 2.1 time: 0.305207 Jan 31 17:14:44.740989 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 483/1055] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:44 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 1328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:44.787216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:44.790227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:44.805767 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:44.807305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:44.810077 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:44.811504 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:45.208711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:45.236719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:45.239642 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:45.244597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d056f49f-1cd5-453b-b7b4-66ab50c5110a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.466058 Jan 31 17:14:45.256075 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 573/1056] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:44 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:14:45.769013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:45.770253 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:45.794255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:45.794255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:45.794255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:45.794255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:45.815092 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] HTTP exception thrown: Instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 could not be found. Jan 31 17:14:45.815868 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Returning 404 to user: Instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:14:45.817166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5a5a4a89-2cfc-412b-af68-68032ce89d94 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 404 len: 111 microversion: 2.1 time: 0.057613 Jan 31 17:14:45.821573 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 484/1057] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:45 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:14:45.851072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3434b1cf-e405-4b7f-8ba1-3699d3785f0a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '.version_select at 0x7fdce2829670>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:45.906270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3434b1cf-e405-4b7f-8ba1-3699d3785f0a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115834682" status: 202 len: 0 microversion: 2.1 time: 0.082891 Jan 31 17:14:45.907307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 574/1058] 10.222.0.91 () {58 vars in 1220 bytes} [Mon Jan 31 17:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115834682 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:14:46.281841 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:46.285779 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:46.302120 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:46.303016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:46.304758 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:46.305659 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:46.935572 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:46.958362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:46.961442 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:46.963434 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3c0689ab-595d-433c-a6c0-a4eafe7517c3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.699236 Jan 31 17:14:46.964238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 485/1059] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:46 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:47.581710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c5ff1d83-a2c6-4731-90a4-24c97cd5323e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: .version_select at 0x7fdce279c040>, body: {"keypair": {"name": "tempest-keypair-433836516"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:47.615488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-c5ff1d83-a2c6-4731-90a4-24c97cd5323e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:14:47.623100 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-c5ff1d83-a2c6-4731-90a4-24c97cd5323e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for user 0edd35fd91c045238a8e7a65bec256cd and project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:14:47.937044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-c5ff1d83-a2c6-4731-90a4-24c97cd5323e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:14:47.946244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-c5ff1d83-a2c6-4731-90a4-24c97cd5323e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for user 0edd35fd91c045238a8e7a65bec256cd and project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:14:47.975595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c5ff1d83-a2c6-4731-90a4-24c97cd5323e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.402627 Jan 31 17:14:47.977037 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 575/1060] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Jan 31 17:14:47 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:47.991630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:48.003957 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:48.022051 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:48.022577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:48.024503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:48.026227 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:48.439964 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:48.455237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:48.458044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:48.460190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-15abca00-b0cd-4e61-9438-9f0b0a1b9d92 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.474602 Jan 31 17:14:48.461932 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 486/1061] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:47 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:49.506605 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:49.507871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:49.547751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:49.548636 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:49.549503 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:49.549960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:49.606006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-d3cf78bb-bf06-4e93-843f-dd3c78b42ff4 req-f673071d-3b33-4648-97d5-b4f020e1a74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "name": "network-vif-plugged", "status": "completed", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:49.611388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:14:49.611388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:14:49.641507 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-d3cf78bb-bf06-4e93-843f-dd3c78b42ff4 req-f673071d-3b33-4648-97d5-b4f020e1a74f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:49.642635 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-d3cf78bb-bf06-4e93-843f-dd3c78b42ff4 req-f673071d-3b33-4648-97d5-b4f020e1a74f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:49.671033 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-d3cf78bb-bf06-4e93-843f-dd3c78b42ff4 req-f673071d-3b33-4648-97d5-b4f020e1a74f service nova] Creating event network-vif-plugged:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:14:49.681372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-d3cf78bb-bf06-4e93-843f-dd3c78b42ff4 req-f673071d-3b33-4648-97d5-b4f020e1a74f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086766 Jan 31 17:14:49.683564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 487/1062] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:14:50.042750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:50.061764 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:50.065285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:50.067471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5dfb0ba8-69a2-414c-8af6-3f280007d0c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.570539 Jan 31 17:14:50.069564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 576/1063] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:49 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:50.879501 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-976720399", "imageRef": "fa40ad57-9ca6-4dd4-82c4-6d59580432f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fce1dfc-5404-4796-a910-cdbbaddc1cc6"}], "security_groups": [{"name": "tempest-securitygroup--814773005"}], "key_name": "tempest-keypair-433836516", "user_data": "}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:51.047262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] validate_networks() for [('4fce1dfc-5404-4796-a910-cdbbaddc1cc6', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:14:51.099089 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:51.099769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:51.115646 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:51.128923 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:51.130342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:51.130342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:51.450701 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:51.460578 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:51.462307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:51.463522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a633aa45-4eb3-4500-a0eb-1a595e44888e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1406 microversion: 2.20 time: 0.369070 Jan 31 17:14:51.476133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 577/1064] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:51 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:51.946912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:14:51.947772 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:14:51.949950 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:14:51.950731 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:14:51.951290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:14:51.968211 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:51.969238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:51.969839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:51.970391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:51.989797 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:14:51.997814 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Getting quotas for user 0edd35fd91c045238a8e7a65bec256cd and project ec95f59938f64b62adb4e61d7b12c80e. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:14:52.011853 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:14:52.015658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa40ad57-9ca6-4dd4-82c4-6d59580432f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:14:52.100340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5563d455-0d24-47ae-b08e-9d28c7c5bbfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.224202 Jan 31 17:14:52.109175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 488/1065] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:14:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:14:52.124938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-56e583c9-c40a-4a30-a774-c0748ada322e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:52.125913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-56e583c9-c40a-4a30-a774-c0748ada322e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:52.214997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-56e583c9-c40a-4a30-a774-c0748ada322e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:52.230507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-56e583c9-c40a-4a30-a774-c0748ada322e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1236 microversion: 2.1 time: 0.111609 Jan 31 17:14:52.231643 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 578/1066] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:52 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:52.496540 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:52.498715 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:52.515835 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:52.516774 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:52.518107 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:52.528939 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:52.764016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:52.783934 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:52.785718 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:52.787487 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-93663c1c-e22b-49af-90d2-c7c9977d05e8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1599 microversion: 2.20 time: 0.299178 Jan 31 17:14:52.788285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 489/1067] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:52 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1599 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:52.818056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:52.818864 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:52.827498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:52.828284 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:52.829712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:52.830418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:52.946359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a7550a5b-b701-4ca6-aa76-c94823c1628f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.135296 Jan 31 17:14:52.946969 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 579/1068] 10.222.0.91 () {60 vars in 1315 bytes} [Mon Jan 31 17:14:52 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:14:53.258151 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:53.259330 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:53.271945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:53.272624 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:53.273739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:53.274523 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:53.490585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:53.518656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-42bf4ffe-7803-4235-a417-7ac43b611303 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1232 microversion: 2.1 time: 0.262671 Jan 31 17:14:53.520732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 490/1069] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:53 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1232 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:54.453523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:54.454533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:54.463852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:54.465421 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:54.466485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:54.467298 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:54.641464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-d1875cd9-1161-40c9-96f2-8fe5dbf18348 req-fb3a4570-3be3-4a71-b1f4-8d2c8784d909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:54.644566 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:14:54.644566 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:14:54.665687 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-d1875cd9-1161-40c9-96f2-8fe5dbf18348 req-fb3a4570-3be3-4a71-b1f4-8d2c8784d909 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:54.666786 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-d1875cd9-1161-40c9-96f2-8fe5dbf18348 req-fb3a4570-3be3-4a71-b1f4-8d2c8784d909 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:54.678467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:54.691800 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-d1875cd9-1161-40c9-96f2-8fe5dbf18348 req-fb3a4570-3be3-4a71-b1f4-8d2c8784d909 service nova] Creating event network-changed:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:14:54.692771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:54.695514 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:54.697481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c24df6e2-5c23-491a-9782-4da1d14b09ca tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1599 microversion: 2.20 time: 0.247931 Jan 31 17:14:54.698898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 580/1070] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:54 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1599 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:54.706878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-d1875cd9-1161-40c9-96f2-8fe5dbf18348 req-fb3a4570-3be3-4a71-b1f4-8d2c8784d909 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251883 Jan 31 17:14:54.707958 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 491/1071] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:14:54.717391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:54.718398 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:54.725222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:54.725671 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:54.726474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:54.726915 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:54.806044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:54.814802 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e534a2f0-9ad3-4bca-b2f7-ba0d862605b9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1232 microversion: 2.1 time: 0.114030 Jan 31 17:14:54.815619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 581/1072] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:54 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1232 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:55.731646 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:55.732655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:55.740513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.741141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.742263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.743335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.760276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:14:55.761669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:55.770422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.770896 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.771711 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.772224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.804755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lazy-loading 'flavor' on Instance uuid 4cada1e7-b97c-481f-bb74-31b3721ef746 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:14:55.907788 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e6ae1f07-a94d-4386-ae55-7a230c8644de tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "POST /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746/action" status: 202 len: 0 microversion: 2.1 time: 0.152972 Jan 31 17:14:55.912167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 582/1073] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:14:55 2022] POST /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:14:55.914739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:55.915460 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:55.923462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.923927 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.925136 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.926011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.948942 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:55.959972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:55.962293 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:55.964941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4193e0f0-945e-4e3a-85f2-3ab5bbcee750 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1599 microversion: 2.20 time: 0.239670 Jan 31 17:14:55.965975 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 492/1074] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:55 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:55.973745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:55.974811 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:55.982625 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.983406 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:55.984628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:55.985280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:56.017739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:56.037085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c0a2da4e-6a37-4a51-900c-36b3e280856b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1232 microversion: 2.1 time: 0.126612 Jan 31 17:14:56.037777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 583/1075] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:55 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1232 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:56.246507 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:56.269509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9de4b583-eab8-4f9f-a110-c1e8e25e4638 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.301137 Jan 31 17:14:56.282541 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 493/1076] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:55 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:56.999076 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:57.012939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:57.034889 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:57.035716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:57.036842 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:57.037294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:57.066980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:57.068207 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:57.088441 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:57.089193 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:57.090887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:57.091691 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:57.248275 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:57.264745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-65b3c78b-8a0f-4496-931b-c0b0c64fdfd0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1306 microversion: 2.1 time: 0.208832 Jan 31 17:14:57.265512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 494/1077] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:57 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1306 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:57.298263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:57.300027 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:57.320789 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:57.321358 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:57.322394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:57.322837 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:57.473594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:57.487039 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:57.489849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:57.492712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b78a3c49-8187-4334-86d7-88f10c311748 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1599 microversion: 2.20 time: 0.500799 Jan 31 17:14:57.493968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 584/1078] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:56 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1599 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:14:57.831907 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:57.845735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6e0f48da-c9d4-4146-87cd-77a8d7e7db5f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.558823 Jan 31 17:14:57.860140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 495/1079] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:57 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:14:58.286268 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:58.287419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:58.296652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:58.297207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:58.298029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:58.298475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:58.519041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:58.519999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:58.535722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:58.536686 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:58.537922 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:58.538724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:58.776424 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:58.791321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9dd20231-7de4-4ba2-a885-4f6bb154e938 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.510020 Jan 31 17:14:58.806179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 585/1080] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:58 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:58.875201 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:58.876386 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:58.887449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:58.888454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:58.889994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:58.890778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:58.919234 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:58.940763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:58.945375 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:58.948882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b5737de2-a581-420b-a1e8-97e606002737 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1716 microversion: 2.20 time: 0.437721 Jan 31 17:14:58.950209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 496/1081] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:14:58 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1716 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:14:58.986709 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:58.987963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:59.007305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:59.008340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:59.009777 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:59.011004 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:59.065147 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-32dd9088-7653-4811-b8ad-a51599bcf19e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/ips" status: 200 len: 151 microversion: 2.20 time: 0.089841 Jan 31 17:14:59.066198 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 497/1082] 10.222.0.91 () {60 vars in 1288 bytes} [Mon Jan 31 17:14:58 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:14:59.375998 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:14:59.385184 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a8408db6-712c-4fc2-a6f8-0b1564e180d0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.516748 Jan 31 17:14:59.386798 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 586/1083] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:58 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:14:59.818826 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:14:59.820581 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:14:59.834711 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:59.835592 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:14:59.837197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:14:59.838271 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:00.008049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-238ee6d7-f216-4142-bb7a-7b72ccbc552f req-7f8c3c61-9e5b-4445-ab70-9fa044057cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595", "tag": "72470c93-0a77-4ff0-9bbd-a0814537721e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:00.010481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:00.010481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:15:00.022582 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-238ee6d7-f216-4142-bb7a-7b72ccbc552f req-7f8c3c61-9e5b-4445-ab70-9fa044057cf2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:00.023046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-238ee6d7-f216-4142-bb7a-7b72ccbc552f req-7f8c3c61-9e5b-4445-ab70-9fa044057cf2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:00.087330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-238ee6d7-f216-4142-bb7a-7b72ccbc552f req-7f8c3c61-9e5b-4445-ab70-9fa044057cf2 service nova] Creating event network-changed:72470c93-0a77-4ff0-9bbd-a0814537721e for instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 on hv-cinder-81566 Jan 31 17:15:00.094815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-238ee6d7-f216-4142-bb7a-7b72ccbc552f req-7f8c3c61-9e5b-4445-ab70-9fa044057cf2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092490 Jan 31 17:15:00.096679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 587/1084] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:15:00.267799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:00.282255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3aeac7e2-bfa0-424a-a68f-cde586fa1dfb tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.470605 Jan 31 17:15:00.283141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 498/1085] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:14:59 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:00.755496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:00.756815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:00.768839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:00.769652 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:00.771101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:00.771912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:01.117982 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:01.129542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a1a2e77f-e70b-4673-a00c-b3d0581dd73f tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.720021 Jan 31 17:15:01.140151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 588/1086] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:00 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:01.313034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:01.316337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:01.337648 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:01.338920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:01.339932 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:01.340646 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:01.635650 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:01.645721 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9fa66f40-14fe-4b02-bc99-bc481cb78e0d tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.340970 Jan 31 17:15:01.656610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 499/1087] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:01 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:02.154795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:02.155385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:02.163563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:02.164169 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:02.165525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:02.166152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:02.361105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:02.374723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-44953b74-9aed-4706-a791-2923f4b4bcf0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.225430 Jan 31 17:15:02.375795 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 589/1088] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:02 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:02.673075 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:02.673864 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:02.681473 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:02.682070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:02.683080 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:02.683578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:02.865171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:02.877126 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-40cc92ff-e180-4dbd-bf9c-5b8e5ce5a17f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.208598 Jan 31 17:15:02.877765 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 500/1089] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:02 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:03.400490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:03.401718 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:03.410211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:03.410672 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:03.411583 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:03.412034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:03.600674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:03.612068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f7d78535-de64-41b0-aab3-038332511dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.218062 Jan 31 17:15:03.613133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 590/1090] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:03 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:03.903387 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:03.903961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:03.911017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:03.911579 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:03.912628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:03.913141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:04.125475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:04.137492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-20ec3ffc-d1b9-4091-a9f2-075a5c0fea63 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.237946 Jan 31 17:15:04.138093 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 501/1091] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:03 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:04.636847 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:04.637832 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:04.648740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:04.649488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:04.651674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:04.652481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:04.839705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:04.848812 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a84b0170-d1a8-4815-a6c6-2dd31960975d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.218404 Jan 31 17:15:04.849405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 591/1092] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:04 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:05.156515 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:05.157438 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:05.166685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:05.167707 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:05.169152 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:05.169926 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:05.693811 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:05.708088 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b4a043af-dbbc-46d4-ae0a-b2593d0672b1 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.555952 Jan 31 17:15:05.709155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 502/1093] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:05 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:05.877769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:05.878418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:05.888771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:05.889496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:05.890755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:05.891432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:06.087172 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:06.105315 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8f9ccf1b-1b91-43b8-8786-ce231c97ff4d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.235286 Jan 31 17:15:06.106246 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 592/1094] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:05 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:06.734700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:06.735483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:06.742654 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:06.743113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:06.743924 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:06.745315 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:06.895458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:06.905499 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-199cd157-80a1-4ff9-9bf2-b2bfef7f34c2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.177857 Jan 31 17:15:06.906079 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 503/1095] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:06 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:07.130067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:07.131093 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:07.141885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:07.142530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:07.143664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:07.144313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:07.340168 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:07.359239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d962f57e-e388-4449-8c05-f51be6467354 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.233229 Jan 31 17:15:07.359973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 593/1096] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:07 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:07.542246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-ade15078-16b7-468f-824a-cd3864de0311 req-4557d34b-5f9e-40ac-b30d-1d2e682a68a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595", "name": "network-vif-plugged", "status": "completed", "tag": "72470c93-0a77-4ff0-9bbd-a0814537721e"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:07.545368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:07.545368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:15:07.562285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ade15078-16b7-468f-824a-cd3864de0311 req-4557d34b-5f9e-40ac-b30d-1d2e682a68a9 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:07.565382 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ade15078-16b7-468f-824a-cd3864de0311 req-4557d34b-5f9e-40ac-b30d-1d2e682a68a9 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:07.597633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-ade15078-16b7-468f-824a-cd3864de0311 req-4557d34b-5f9e-40ac-b30d-1d2e682a68a9 service nova] Creating event network-vif-plugged:72470c93-0a77-4ff0-9bbd-a0814537721e for instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 on hv-cinder-81566 Jan 31 17:15:07.607423 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-ade15078-16b7-468f-824a-cd3864de0311 req-4557d34b-5f9e-40ac-b30d-1d2e682a68a9 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071636 Jan 31 17:15:07.608464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 504/1097] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:07.932456 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:07.933245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:07.940777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:07.941397 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:07.942314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:07.942898 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:08.224241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:08.235564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d879acbd-41aa-4652-a0db-900f2d4c501e tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.309401 Jan 31 17:15:08.236291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 594/1098] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:07 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:08.399276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:08.403081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:08.410859 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:08.411525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:08.412838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:08.413506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:08.582282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:08.590606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b651e578-3dd3-4187-bc07-8739c0cd8214 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.198732 Jan 31 17:15:08.591196 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 505/1099] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:08 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:09.257644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:09.258520 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:09.269810 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:09.270266 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:09.271082 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:09.271524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:09.454280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:09.465777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-10fbff46-a487-4c1b-98fd-fe6e50e0c6fa tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1361 microversion: 2.1 time: 0.211867 Jan 31 17:15:09.466315 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 595/1100] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:09 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:09.610615 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:09.611610 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:09.625195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:09.626024 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:09.627430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:09.628276 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:09.791058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:09.799645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-23c4bb99-2c3d-404c-a6da-72d2f85ae918 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.194973 Jan 31 17:15:09.800243 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 506/1101] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:09 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:10.486624 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:10.487665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:10.499038 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:10.499760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:10.501049 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:10.501761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:10.697899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:10.705975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7a32f0c8-81a9-40c4-af7e-332aa5fccae8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1547 microversion: 2.1 time: 0.225560 Jan 31 17:15:10.706619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 596/1102] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:10 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1547 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:10.737178 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:10.738057 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:10.750395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:10.751189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:10.752612 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:10.753425 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:10.821036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:10.821836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:10.830210 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:10.830787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:10.831613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:10.832063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:10.863081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e032bc32-8cc7-4926-8ebe-4cb1d37b10e2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134293 Jan 31 17:15:10.863764 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 507/1103] 10.222.0.91 () {58 vars in 1274 bytes} [Mon Jan 31 17:15:10 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:11.012058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:11.022240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-46aaedbb-6dd5-46b8-98a9-d33eabebab1a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.204857 Jan 31 17:15:11.023123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 597/1104] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:10 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:12.048263 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:12.049561 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:12.059159 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:12.061393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:12.063374 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:12.064137 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:12.089672 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:12.090407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:12.100670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:12.104852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:12.106825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:12.106825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:12.407398 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:12.412020 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:12.418326 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d6ab3edb-2143-489b-880c-850af0be0609 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1547 microversion: 2.1 time: 0.334159 Jan 31 17:15:12.419101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 598/1105] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:12 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1547 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:12.424774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-f009b3c3-c851-4d41-8838-e43e56acbdee req-e01b0301-ecb5-4e3d-b54e-d27d842de3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595", "tag": "72470c93-0a77-4ff0-9bbd-a0814537721e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:12.427461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:12.427461 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:15:12.433542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2d28df08-77bd-48d5-9d86-cb005e896924 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.388802 Jan 31 17:15:12.434611 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 508/1106] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:12 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:12.437817 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f009b3c3-c851-4d41-8838-e43e56acbdee req-e01b0301-ecb5-4e3d-b54e-d27d842de3b3 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:12.438269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f009b3c3-c851-4d41-8838-e43e56acbdee req-e01b0301-ecb5-4e3d-b54e-d27d842de3b3 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:12.451844 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-f009b3c3-c851-4d41-8838-e43e56acbdee req-e01b0301-ecb5-4e3d-b54e-d27d842de3b3 service nova] Creating event network-changed:72470c93-0a77-4ff0-9bbd-a0814537721e for instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 on hv-cinder-81566 Jan 31 17:15:12.457727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-f009b3c3-c851-4d41-8838-e43e56acbdee req-e01b0301-ecb5-4e3d-b54e-d27d842de3b3 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037212 Jan 31 17:15:12.458436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 599/1107] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:13.436287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:13.437364 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:13.449351 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:13.449815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:13.450642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:13.451088 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:13.458513 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:13.459691 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:13.470066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:13.470824 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:13.472260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:13.472928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:13.712452 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:13.715342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:13.722573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bd406c71-18df-4ee7-b6c3-02b414e601c5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.269684 Jan 31 17:15:13.723089 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 600/1108] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:13 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:13.723651 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1734ebd1-32e6-46c5-8dc1-75726e021960 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1665 microversion: 2.1 time: 0.292460 Jan 31 17:15:13.724260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 509/1109] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:13 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1665 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:13.745968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:13.746521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:13.753061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:13.753524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:13.754304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:13.754756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:13.781417 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-76d5865d-4e00-4b39-ae79-f5fd4a21ade6 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/ips" status: 200 len: 145 microversion: 2.1 time: 0.040122 Jan 31 17:15:13.782024 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 601/1110] 10.222.0.91 () {58 vars in 1247 bytes} [Mon Jan 31 17:15:13 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:14.742575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:14.743595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:14.751647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:14.752210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:14.753135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:14.753622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:14.929668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:14.939013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-408901cb-2e66-4cac-a7db-712b8aef8701 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.200429 Jan 31 17:15:14.939605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 510/1111] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:14 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:15.165344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:15.166522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:15.173235 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:15.173694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:15.174510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:15.175155 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:15.655690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fdc0e12d-66f7-459d-9246-5db4b79cf57c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494160 Jan 31 17:15:15.661697 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 602/1112] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:15:15 2022] POST /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:15:15.964506 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:15.965628 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:15.974692 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:15.975495 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:15.976951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:15.977642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:16.185896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:16.198808 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b2a53691-fcea-4eb8-ab76-3a5ca284e7fa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1566 microversion: 2.1 time: 0.240641 Jan 31 17:15:16.199668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 511/1113] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:15 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:16.224269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:16.224932 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:16.232372 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:16.232840 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:16.234185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:16.234791 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:16.330538 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-83d65eff-7ce8-45d1-9afe-99ffbcfbd639 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "POST /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746/action" status: 202 len: 0 microversion: 2.1 time: 0.111156 Jan 31 17:15:16.332598 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 603/1114] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:15:16 2022] POST /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:15:16.340465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:16.341125 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:16.349839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:16.351087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:16.352912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:16.353301 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:16.551177 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:16.563512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6ada1a95-c74d-4eea-9675-7e13122f00ec tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1574 microversion: 2.1 time: 0.227124 Jan 31 17:15:16.564138 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 512/1115] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:16 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:17.583018 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:17.583644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:17.592556 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:17.593359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:17.594741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:17.595477 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:17.753458 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:17.762250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4b0a76e8-9112-4a9c-986e-c804a888554a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1516 microversion: 2.1 time: 0.183324 Jan 31 17:15:17.762920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 604/1116] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:17 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:18.359213 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-547021589"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:18.359850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:18.369841 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:18.370312 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:18.371132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:18.371585 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:18.535005 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.network.security_group_api [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Removing security group 695876e0-3f52-4878-a92a-84a408143c36 from port 113a6e12-5c1e-439d-b292-bfffe7574544 Jan 31 17:15:18.789344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:18.790628 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:18.800573 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:18.801292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:18.802575 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:18.803325 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:19.107096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4d7799d7-116f-4001-ad0b-771d53cfb0d5 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/action" status: 202 len: 0 microversion: 2.1 time: 0.749975 Jan 31 17:15:19.110645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 513/1117] 10.222.0.91 () {60 vars in 1277 bytes} [Mon Jan 31 17:15:18 2022] POST /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:15:19.135051 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-6a767f74-0338-4b4a-ab67-e844d033bd5e req-b49e2cdd-2b48-4747-b8f1-40b7390de812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:19.143148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:19.143148 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:15:19.162258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:19.175882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5720ba78-6479-4116-b1bb-3db4d482b7f4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1516 microversion: 2.1 time: 0.392363 Jan 31 17:15:19.176356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-6a767f74-0338-4b4a-ab67-e844d033bd5e req-b49e2cdd-2b48-4747-b8f1-40b7390de812 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:19.177167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-6a767f74-0338-4b4a-ab67-e844d033bd5e req-b49e2cdd-2b48-4747-b8f1-40b7390de812 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:19.177669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 605/1118] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:18 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1516 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:19.216777 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-6a767f74-0338-4b4a-ab67-e844d033bd5e req-b49e2cdd-2b48-4747-b8f1-40b7390de812 service nova] Creating event network-changed:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:15:19.227337 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-6a767f74-0338-4b4a-ab67-e844d033bd5e req-b49e2cdd-2b48-4747-b8f1-40b7390de812 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099978 Jan 31 17:15:19.231633 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 514/1119] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:15:19.730656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-23ff8cff-19d2-487b-a115-e3cb38aa7667 req-e458d9f0-ff7b-4f7f-a4e1-b91ac9de7879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "name": "network-vif-unplugged", "status": "completed", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:19.733366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:19.733366 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:15:19.746071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-23ff8cff-19d2-487b-a115-e3cb38aa7667 req-e458d9f0-ff7b-4f7f-a4e1-b91ac9de7879 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:19.747095 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-23ff8cff-19d2-487b-a115-e3cb38aa7667 req-e458d9f0-ff7b-4f7f-a4e1-b91ac9de7879 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:19.761901 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.compute.server_external_events [req-23ff8cff-19d2-487b-a115-e3cb38aa7667 req-e458d9f0-ff7b-4f7f-a4e1-b91ac9de7879 service nova] Unable to find a host for instance 4cada1e7-b97c-481f-bb74-31b3721ef746. Dropping event network-vif-unplugged {{(pid=116483) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 31 17:15:19.764056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-23ff8cff-19d2-487b-a115-e3cb38aa7667 req-e458d9f0-ff7b-4f7f-a4e1-b91ac9de7879 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037940 Jan 31 17:15:19.765783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 606/1120] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 31 17:15:20.207462 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:20.208343 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:20.216324 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:20.217339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:20.218739 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:20.223793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:20.433227 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:20.447580 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9fd1890d-38e6-4702-8152-f44b95a5ca87 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1516 microversion: 2.1 time: 0.243894 Jan 31 17:15:20.448870 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 515/1121] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:20 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:21.020497 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:21.021270 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:21.042745 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-3a4e7794-4dc9-4dfc-85c9-53b5f6224279 req-84fef030-6a2e-476c-9c27-45449d144d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:21.043204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.043957 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.045322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.046063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.049530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:21.049530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:15:21.068034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-3a4e7794-4dc9-4dfc-85c9-53b5f6224279 req-84fef030-6a2e-476c-9c27-45449d144d40 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.069085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-3a4e7794-4dc9-4dfc-85c9-53b5f6224279 req-84fef030-6a2e-476c-9c27-45449d144d40 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.096832 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-3a4e7794-4dc9-4dfc-85c9-53b5f6224279 req-84fef030-6a2e-476c-9c27-45449d144d40 service nova] Creating event network-changed:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:15:21.108041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-3a4e7794-4dc9-4dfc-85c9-53b5f6224279 req-84fef030-6a2e-476c-9c27-45449d144d40 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078462 Jan 31 17:15:21.112260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 516/1122] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:15:21.186817 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lazy-loading 'services' on Instance uuid 2600c312-08a3-44fe-a01c-a135e4ee8e57 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:15:21.321431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d36b8b26-497f-4713-9503-ff57bfd8662b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments/d1dac58f-19e1-4666-9066-1c2a439b9131" status: 202 len: 0 microversion: 2.1 time: 0.312624 Jan 31 17:15:21.323922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 607/1123] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:15:21 2022] DELETE /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments/d1dac58f-19e1-4666-9066-1c2a439b9131 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:15:21.337381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:21.342383 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:21.352956 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.354752 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.355754 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.356668 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.405593 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9e973f25-a76c-4802-85ad-e2df98fd9bf0 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075899 Jan 31 17:15:21.406365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 517/1124] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:21 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:21.471938 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:21.473729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:21.484847 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.486188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.487987 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:21.488835 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:21.761740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:21.773572 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a2f3fd94-6b15-40b6-8768-5de986802674 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1516 microversion: 2.1 time: 0.310366 Jan 31 17:15:21.774588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 608/1125] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:21 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:22.423649 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:22.424999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:22.434410 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:22.435367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:22.436875 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:22.437673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:22.474142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-aad29ee1-a6cd-4eb6-9697-9f36dff0ebba tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057238 Jan 31 17:15:22.474735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 518/1126] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:22 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:22.802250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:22.803318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:22.813406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:22.813845 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:22.814890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:22.815586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.383368 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:23.384645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:23.387941 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:23.391660 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:23.392767 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.393296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:23.393656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.399604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-220b3db7-5973-4611-a611-8d96c82d9dc7 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1516 microversion: 2.1 time: 0.602757 Jan 31 17:15:23.401376 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 609/1127] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:22 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1516 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:23.441050 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c676e4ce-f322-49eb-bf7d-203facdd8715 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062252 Jan 31 17:15:23.441918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 519/1128] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:23 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:15:23.453154 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:23.453673 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:23.461196 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:23.462169 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.464083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:23.464856 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.489461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:23.491213 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:23.500513 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:23.501306 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.502696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:23.503472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:23.515953 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4681e649-864a-45f9-beff-9548164c68ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5" status: 200 len: 194 microversion: 2.1 time: 0.066476 Jan 31 17:15:23.517247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 610/1129] 10.222.0.91 () {58 vars in 1412 bytes} [Mon Jan 31 17:15:23 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:23.558223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9f6a96a4-b291-4305-b043-8147d371c87e tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072922 Jan 31 17:15:23.559152 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 520/1130] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:23 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:24.423004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:24.423674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:24.430127 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:24.430796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:24.432579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:24.432929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:24.575474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:24.576875 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:24.585167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:24.585775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:24.586656 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:24.587351 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:24.625733 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:24.630734 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2afdfe1e-e23a-47e3-9969-9593a8f50216 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060956 Jan 31 17:15:24.631564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 521/1131] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:24 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:24.638986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a3bbc3a1-e892-438b-bbff-0a4a1ac2dc9d tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1516 microversion: 2.1 time: 0.219664 Jan 31 17:15:24.639558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 611/1132] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:24 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:24.957518 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "915b110c-1c54-432b-873c-5858f3ac3838"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:24.959351 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:24.970152 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:24.970977 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:24.972445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:24.973257 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:25.381744 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-47314fab-1704-4bbf-b631-76aaace700d8 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "POST /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431193 Jan 31 17:15:25.382370 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 522/1133] 10.222.0.91 () {60 vars in 1322 bytes} [Mon Jan 31 17:15:24 2022] POST /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:25.645821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:25.646974 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:25.654683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:25.655132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:25.656202 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:25.656640 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:25.658121 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:25.659028 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:25.667703 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:25.668546 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:25.670472 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:25.671470 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:25.694920 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0e869cc2-5777-43f4-a8f2-a5adba7766d6 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053254 Jan 31 17:15:25.695508 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 612/1134] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:25 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:25.992537 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:26.005174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8933033e-41e0-4beb-a701-27e0b389180a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.351246 Jan 31 17:15:26.007014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 523/1135] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:25 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:26.708523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:26.709472 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:26.718847 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:26.719516 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:26.720859 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:26.721659 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:26.764498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b0b6b7c6-cf7e-4fcb-8635-2d3ec02edb33 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059814 Jan 31 17:15:26.765269 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 613/1136] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:26 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:15:26.777693 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:26.778307 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:26.796153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:26.796901 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:26.798256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:26.798962 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:26.900341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] HTTP exception thrown: Instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 is not attached to volume d1dac58f-19e1-4666-9066-1c2a439b9131 Jan 31 17:15:26.901238 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Returning 404 to user: Instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 is not attached to volume d1dac58f-19e1-4666-9066-1c2a439b9131 {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:15:26.902267 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-8c4af4d9-ecdc-427a-b203-1c3c431dbe89 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments/d1dac58f-19e1-4666-9066-1c2a439b9131" status: 404 len: 154 microversion: 2.1 time: 0.129173 Jan 31 17:15:26.903123 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 524/1137] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:15:26 2022] DELETE /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57/os-volume_attachments/d1dac58f-19e1-4666-9066-1c2a439b9131 => generated 154 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:15:27.036683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:27.036683 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:27.038666 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:27.039123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:27.039978 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:27.040618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:27.235525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:27.250690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-523e349a-7372-46db-a97e-ed20a9f97cc4 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.226209 Jan 31 17:15:27.251728 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 614/1138] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:27 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:28.077418 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:28.078052 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:28.085609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:28.086223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:28.088591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:28.089884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:28.122690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:15:28.233354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-408c5224-c600-44c0-b712-ce99ed792b83 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 204 len: 0 microversion: 2.1 time: 0.160846 Jan 31 17:15:28.234395 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 525/1139] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:15:28 2022] DELETE /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:15:28.247629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:28.248506 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:28.260454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:28.261531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:28.262964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:28.263748 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:28.282153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:28.283248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:28.293887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:28.294533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:28.295601 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:28.296280 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:28.552772 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:28.555576 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:28.566627 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-90792dfd-4587-4982-ad46-cfe32ac1c1b9 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.291832 Jan 31 17:15:28.567951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 526/1140] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:28 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:28.569028 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9c1990e4-f514-4654-8b63-d0f1b0340dd2 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1554 microversion: 2.1 time: 0.327033 Jan 31 17:15:28.570070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 615/1141] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:28 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1554 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:29.594546 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:29.595341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:29.602221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:29.604464 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:29.606013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:29.606804 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:29.608182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:29.608962 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:29.616438 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:29.617632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:29.618653 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:29.619165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:29.877690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:29.887091 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1df37594-15b2-4a48-a05c-753d041e7b7e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.299149 Jan 31 17:15:29.892304 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 527/1142] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:29 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:29.893494 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:29.906895 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ad925d4a-2c3c-4fef-9cd2-9358e82f3f10 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1554 microversion: 2.1 time: 0.311873 Jan 31 17:15:29.907801 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 616/1143] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:29 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:30.909951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:30.911064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:30.924340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:30.925007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:30.925984 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:30.926760 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:30.936239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:30.937379 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:30.948963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:30.949765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:30.951071 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:30.951876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:31.257394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:31.263751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:31.271563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4ad29602-9c7c-45c5-9f27-8a805f4b28df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.368149 Jan 31 17:15:31.271826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-49209594-3cda-4a0c-8d11-608af4dbeeef tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1554 microversion: 2.1 time: 0.342534 Jan 31 17:15:31.272564 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 617/1144] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:30 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1554 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:31.272899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 528/1145] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:30 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:31.970939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-a2efa861-2051-45ea-8467-83756486c525 req-f8368c61-50e0-48b5-8a13-130bcb99a1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2600c312-08a3-44fe-a01c-a135e4ee8e57", "name": "network-vif-deleted", "tag": "113a6e12-5c1e-439d-b292-bfffe7574544"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:31.974594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:31.974594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:15:31.985465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a2efa861-2051-45ea-8467-83756486c525 req-f8368c61-50e0-48b5-8a13-130bcb99a1a2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:31.985919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a2efa861-2051-45ea-8467-83756486c525 req-f8368c61-50e0-48b5-8a13-130bcb99a1a2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:32.006881 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-a2efa861-2051-45ea-8467-83756486c525 req-f8368c61-50e0-48b5-8a13-130bcb99a1a2 service nova] Creating event network-vif-deleted:113a6e12-5c1e-439d-b292-bfffe7574544 for instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 on hv-cinder-81566 Jan 31 17:15:32.013665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-a2efa861-2051-45ea-8467-83756486c525 req-f8368c61-50e0-48b5-8a13-130bcb99a1a2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048928 Jan 31 17:15:32.014560 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 618/1146] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:32.298214 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:32.299827 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:32.301681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:32.308878 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:32.314971 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:32.315754 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:32.317314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:32.318379 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:32.321739 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:32.322894 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:32.324493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:32.325067 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:32.373558 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:32.374019 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:32.374498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lazy-loading 'fault' on Instance uuid 2600c312-08a3-44fe-a01c-a135e4ee8e57 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:15:32.461256 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3583e4e66b7644fc8bf78cd2f94bffb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894b01e219924a8abe1a46602ad87782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:32.479362 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e1a1a755-14e7-4034-84be-c20b8eb57d6c tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 200 len: 1349 microversion: 2.1 time: 0.184541 Jan 31 17:15:32.481543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 619/1147] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:32 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 1349 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:32.593604 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:32.604661 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-058bdb2b-94de-437f-8ff8-60be432021b0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.313890 Jan 31 17:15:32.605260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 529/1148] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:32 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:33.501946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:33.503316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] [instance: 2600c312-08a3-44fe-a01c-a135e4ee8e57] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:33.515222 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:33.516040 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:33.517501 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:33.518328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:33.553916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] HTTP exception thrown: Instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 could not be found. Jan 31 17:15:33.554823 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Returning 404 to user: Instance 2600c312-08a3-44fe-a01c-a135e4ee8e57 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:15:33.556997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-790d11df-2a91-4792-886d-9f87807cc4d7 tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57" status: 404 len: 111 microversion: 2.1 time: 0.059738 Jan 31 17:15:33.557940 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 620/1149] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:33 2022] GET /compute/v2.1/servers/2600c312-08a3-44fe-a01c-a135e4ee8e57 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:15:33.570562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1d7ebcfa-8f86-4628-a662-e281080e377b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] Calling method '.version_select at 0x7fdce2830c10>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:33.624298 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:33.624921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:33.632016 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:33.633364 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:33.634738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:33.635225 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:33.833764 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:33.835256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1d7ebcfa-8f86-4628-a662-e281080e377b tempest-TestMinimumBasicScenario-952916187 tempest-TestMinimumBasicScenario-952916187-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2006550850" status: 202 len: 0 microversion: 2.1 time: 0.270491 Jan 31 17:15:33.836503 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 530/1150] 10.222.0.91 () {58 vars in 1271 bytes} [Mon Jan 31 17:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2006550850 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:15:33.847955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-95579c94-902a-4ae0-acfb-aa6c56efd5aa tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.228131 Jan 31 17:15:33.848852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 621/1151] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:33 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:15:34.248474 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:34.250113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:34.270224 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:34.271235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:34.272707 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:34.273559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:34.333658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-755ee802-675e-498d-a1f0-35e78f03ca6c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.091777 Jan 31 17:15:34.338603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 531/1152] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:15:34 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments => generated 371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:34.877723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:34.878719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:34.890591 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:34.891305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:34.892294 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:34.892892 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:35.388227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:35.410535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-057d2035-e98c-4ce0-ada3-1ef0b69127a5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.539412 Jan 31 17:15:35.414700 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 622/1153] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:34 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:36.440698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:36.441574 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:36.457409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:36.458049 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:36.462983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:36.462983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:36.863618 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:36.878884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-142c1b28-5663-4cd2-8bab-c528bf7a251a tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.444581 Jan 31 17:15:36.879918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 532/1154] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:36 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:37.905195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:37.905937 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:37.918289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:37.919571 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:37.921177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:37.922048 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:38.632449 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:38.647720 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-08dd4a26-0bf0-4471-95e6-3a23c711e2df tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.747684 Jan 31 17:15:38.648884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 623/1155] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:37 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:39.684763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:39.686886 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:39.699273 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:39.700165 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:39.701582 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:39.703372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:39.812565 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-4a695574-89aa-4e2e-af8f-67fa6d1a496b req-b0cd7ebc-c785-40ad-a6ac-75a4df7d8546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "name": "network-vif-plugged", "status": "completed", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:39.824061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:15:39.824061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:15:39.839020 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-4a695574-89aa-4e2e-af8f-67fa6d1a496b req-b0cd7ebc-c785-40ad-a6ac-75a4df7d8546 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:39.841611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-4a695574-89aa-4e2e-af8f-67fa6d1a496b req-b0cd7ebc-c785-40ad-a6ac-75a4df7d8546 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:39.863581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-4a695574-89aa-4e2e-af8f-67fa6d1a496b req-b0cd7ebc-c785-40ad-a6ac-75a4df7d8546 service nova] Creating event network-vif-plugged:e7ff3fe5-09f9-4881-8621-ae4162f6a416 for instance 4cada1e7-b97c-481f-bb74-31b3721ef746 on hv-cinder-81566 Jan 31 17:15:39.874282 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-4a695574-89aa-4e2e-af8f-67fa6d1a496b req-b0cd7ebc-c785-40ad-a6ac-75a4df7d8546 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067297 Jan 31 17:15:39.876804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 624/1156] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:15:40.158787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:40.176516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3cf55c65-9e34-4d20-9a43-71c433a04b37 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.500596 Jan 31 17:15:40.192266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 533/1157] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:39 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:41.210454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:41.212175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:41.222227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:41.222681 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:41.223503 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:41.223946 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:41.521953 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:41.536229 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-19f93b3e-7f1d-4507-b365-32fe2d826ece tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1572 microversion: 2.1 time: 0.332932 Jan 31 17:15:41.537408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 625/1158] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:41 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1572 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:42.560058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:42.562144 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:42.574325 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:42.575258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:42.576563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:42.577348 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:42.855795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:42.871564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-67e13b63-4bce-49a2-a65a-e1a9274b815e tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1559 microversion: 2.1 time: 0.318594 Jan 31 17:15:42.872740 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 534/1159] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:15:42 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1559 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:15:46.621864 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:15:46.622786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:46.646665 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:46.647287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:46.648661 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:46.649454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:46.688887 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.objects.instance [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lazy-loading 'flavor' on Instance uuid 2850f1c6-52bb-46bf-acba-2fd62526c232 {{(pid=116483) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:15:47.079471 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-6720bb51-e133-42be-9aa1-3b292aa76832 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/action" status: 202 len: 0 microversion: 2.20 time: 0.463056 Jan 31 17:15:47.080261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 626/1160] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Jan 31 17:15:46 2022] POST /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:15:47.095378 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:47.096373 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:47.105993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:47.107232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:47.109391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:47.110271 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:47.399527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:47.417659 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:47.420867 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:47.422684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0c861a0e-a876-45ee-88ba-0b53c88f2767 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.334089 Jan 31 17:15:47.423605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 535/1161] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:47 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:15:48.451531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:48.451531 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:48.458771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:48.460291 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:48.461559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:48.461811 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:48.683522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:48.698609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:48.700710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:48.702112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-57be59c4-79e5-4c02-b23c-4b5183190c45 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.260605 Jan 31 17:15:48.703381 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 627/1162] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:48 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:49.739813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:49.741249 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:49.753449 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:49.754179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:49.755813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:49.757202 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:49.990882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:50.004757 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:50.006608 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:50.009209 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-6db2304d-0136-48f0-a434-1d98aefba2db tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.274940 Jan 31 17:15:50.011060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 536/1163] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:49 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:51.036390 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:51.038036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:51.052662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:51.052662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:51.052662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:51.052662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:51.412819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:51.425579 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:51.428964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:51.430751 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0f78b8aa-3cd6-4123-b55e-3ee089fd2a41 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.402109 Jan 31 17:15:51.441829 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 628/1164] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:51 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:52.456076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:52.458234 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:52.472813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:52.474309 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:52.476056 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:52.478342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:52.954750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:52.966027 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:52.969385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:52.971215 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-31f123e2-e1c7-4eb9-8ff5-33915bba10f9 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.523890 Jan 31 17:15:52.972490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 537/1165] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:52 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:54.007569 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:54.008854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:54.018186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:54.019105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:54.020344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:54.020925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:54.452973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:54.467429 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:54.469916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:54.471964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2fc156d9-80b1-444a-a2d7-9574226bf969 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.473650 Jan 31 17:15:54.473302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 629/1166] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:53 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:55.497858 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:55.499128 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:55.507186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:55.507757 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:55.509623 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:55.510591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:55.929491 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:55.944069 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:55.947975 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:55.950963 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-37f17ecd-c3bd-43e8-9c61-34c29ca4217f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.456558 Jan 31 17:15:55.952325 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 538/1167] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:55 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:56.982242 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:56.983727 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:56.991239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:56.992004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:56.993325 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:56.993775 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:57.303518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:57.314708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:57.316289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:57.317697 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9d81aa8a-059b-4c14-8a0a-66d1e54c0838 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.341130 Jan 31 17:15:57.332609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 630/1168] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:56 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:58.353873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:58.357667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:58.375692 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:58.376298 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:58.377166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:58.378101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:58.659716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:58.672776 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:58.678015 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:15:58.681149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-125ded3f-9099-4ea1-9090-1f0e750008c8 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.339203 Jan 31 17:15:58.682662 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 539/1169] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:58 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:15:59.711944 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:15:59.714337 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:15:59.726340 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:59.735445 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:15:59.737615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:15:59.738729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:00.038425 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:00.051893 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:00.058856 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:00.060784 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b8daec22-098c-4e56-8a20-e4d13a87eb56 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.356677 Jan 31 17:16:00.065078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 631/1170] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:15:59 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:01.088400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:01.090534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:01.102504 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:01.103283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:01.105032 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:01.106074 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:01.509205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:01.522559 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:01.525168 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:01.527006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-78fcd0ec-aa3d-4300-9d97-5d08fb2e0e4a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.446347 Jan 31 17:16:01.528840 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 540/1171] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:01 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:02.575313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:02.578128 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:02.590143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:02.590963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:02.592213 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:02.592927 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:03.001004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:03.014175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:03.016836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:03.018445 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-33468426-f594-4436-a028-3399c7b46009 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.457114 Jan 31 17:16:03.019432 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 632/1172] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:02 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:04.044837 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:04.045699 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:04.054133 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:04.067632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:04.076273 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:04.077327 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:04.572166 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:04.584545 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:04.587490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:04.590314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-668e4e07-8997-4634-8fba-141155dbccf1 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1743 microversion: 2.20 time: 0.552143 Jan 31 17:16:04.591850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 541/1173] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:04 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1743 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:05.067476 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b30c423d-e13f-44ab-96c5-e44efc424e30 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Action: 'create', calling method: .version_select at 0x7fdce27cbb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1962695943"}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:05.082523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-b30c423d-e13f-44ab-96c5-e44efc424e30 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for project 0070c6d36b294fcd87adac6ded40165c. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:16:05.087903 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-b30c423d-e13f-44ab-96c5-e44efc424e30 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for user e2b3b1f45d1b4b4995bad98ce0236b07 and project 0070c6d36b294fcd87adac6ded40165c. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:16:05.393124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-b30c423d-e13f-44ab-96c5-e44efc424e30 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for project 0070c6d36b294fcd87adac6ded40165c. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:16:05.399307 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-b30c423d-e13f-44ab-96c5-e44efc424e30 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for user e2b3b1f45d1b4b4995bad98ce0236b07 and project 0070c6d36b294fcd87adac6ded40165c. Resources: {'key_pairs'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:16:05.420719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b30c423d-e13f-44ab-96c5-e44efc424e30 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.635659 Jan 31 17:16:05.421433 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 633/1174] 10.222.0.91 () {60 vars in 1157 bytes} [Mon Jan 31 17:16:04 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:05.627283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:05.628931 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:05.661113 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:05.662073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:05.663434 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:05.664275 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:06.034229 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:06.056241 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:06.059836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:06.062742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-fec52a6a-393b-4d67-a1b0-799a2fe6e4c7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1743 microversion: 2.20 time: 0.441568 Jan 31 17:16:06.064510 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 542/1175] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:05 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1743 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:07.110826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:07.118884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:07.141086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:07.142086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:07.151899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:07.153500 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:07.586240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:07.619529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:07.629729 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:07.636192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-55554a39-09ae-4bbc-953a-fc0f3da0ee83 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.533110 Jan 31 17:16:07.638925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 634/1176] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:07 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:08.003321 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-956cb784-c3ea-42fc-a085-d2e3e3049dbf req-b577179b-7cc9-4795-a251-15727ad0fc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "name": "network-vif-plugged", "status": "completed", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:08.012221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:16:08.012221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:16:08.039334 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-956cb784-c3ea-42fc-a085-d2e3e3049dbf req-b577179b-7cc9-4795-a251-15727ad0fc66 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:08.040185 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-956cb784-c3ea-42fc-a085-d2e3e3049dbf req-b577179b-7cc9-4795-a251-15727ad0fc66 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:08.092490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-956cb784-c3ea-42fc-a085-d2e3e3049dbf req-b577179b-7cc9-4795-a251-15727ad0fc66 service nova] Creating event network-vif-plugged:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:16:08.106439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-956cb784-c3ea-42fc-a085-d2e3e3049dbf req-b577179b-7cc9-4795-a251-15727ad0fc66 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108270 Jan 31 17:16:08.112494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 543/1177] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:08.671989 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:08.674034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:08.713710 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:08.715052 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:08.717411 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:08.720563 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:09.174897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:09.192265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:09.197059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:09.199668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7e81e933-5e77-46fa-8194-3edfd3919a09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.535249 Jan 31 17:16:09.201478 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 635/1178] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:08 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:10.238751 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:10.240560 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:10.262168 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:10.263534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:10.265221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:10.266254 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:10.591090 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:10.608138 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:10.611187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:10.613446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-597642e1-9af3-4871-bfda-dad9da24b088 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.382669 Jan 31 17:16:10.620763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 544/1179] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:10 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:11.650058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:11.651142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:11.676814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:11.677994 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:11.679835 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:11.681015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:12.015644 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:12.034880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:12.041512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:12.043818 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fcf8d79b-ed42-481b-8085-a9297242e0b7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.400005 Jan 31 17:16:12.060144 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 636/1180] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:11 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:13.080426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:13.081447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:13.095847 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:13.097673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:13.100243 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:13.101422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:13.379613 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:13.391029 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:13.392582 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:13.394520 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0f94f1ba-edc5-465f-ba70-9da9803b12ce tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.322486 Jan 31 17:16:13.404511 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 545/1181] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:13 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:14.338166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:14.338966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:14.351922 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:14.355253 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:14.357051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:14.357709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:14.397111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8e797381-9c4e-457d-a7fb-611db372b493 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5" status: 200 len: 194 microversion: 2.1 time: 0.065849 Jan 31 17:16:14.397959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 637/1182] 10.222.0.91 () {58 vars in 1412 bytes} [Mon Jan 31 17:16:14 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:14.418696 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:14.420700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:14.423206 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:14.424044 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:14.431972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:14.433571 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:14.435343 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:14.436058 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:14.436220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:14.437137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:14.440149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:14.440933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:14.571390 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lazy-loading 'services' on Instance uuid 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:16:14.738070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d1b7e8e6-0a59-4b0f-a06b-9050a9ac1cf4 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5" status: 202 len: 0 microversion: 2.1 time: 0.326943 Jan 31 17:16:14.749613 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 546/1183] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:16:14 2022] DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/d7a45d78-4fae-439a-a0b3-fa6d7fff8eb5 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:16:14.864204 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:14.877287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:14.879017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:14.880285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4648c9e3-e30d-4411-ab60-5c3f8c22ee08 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.462875 Jan 31 17:16:14.881280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 638/1184] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:14 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:15.919067 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:15.919894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:15.934210 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:15.934645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:15.935979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:15.936657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:16.238588 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:16.249900 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:16.251639 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:16.252945 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f957912c-b8c4-4907-b601-c62941ec33e0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.341801 Jan 31 17:16:16.253529 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 547/1185] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:15 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:17.117735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:17.118786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:17.130709 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:17.132335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:17.134110 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:17.135105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:17.192899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-657ab3eb-065f-4a98-bb9b-d6e600e6d22a tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/915b110c-1c54-432b-873c-5858f3ac3838" status: 200 len: 194 microversion: 2.1 time: 0.082577 Jan 31 17:16:17.210130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:17.211184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:17.213645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 639/1186] 10.222.0.91 () {58 vars in 1412 bytes} [Mon Jan 31 17:16:17 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/915b110c-1c54-432b-873c-5858f3ac3838 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:17.222688 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:17.223419 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:17.225035 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:17.226918 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:17.279360 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:17.280345 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:17.291616 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:17.292859 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:17.294485 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:17.295263 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:17.405290 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lazy-loading 'services' on Instance uuid 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:16:17.559343 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-98f7f329-3006-4cc6-b262-f8be19b2506c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/915b110c-1c54-432b-873c-5858f3ac3838" status: 202 len: 0 microversion: 2.1 time: 0.355427 Jan 31 17:16:17.568173 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 548/1187] 10.222.0.91 () {58 vars in 1415 bytes} [Mon Jan 31 17:16:17 2022] DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments/915b110c-1c54-432b-873c-5858f3ac3838 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:16:17.600389 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:17.631448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:17.633754 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:17.635457 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-74774e49-cc06-4625-a5fc-a4b30ba2a45e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.366042 Jan 31 17:16:17.636046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 640/1188] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:17 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:18.658781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:18.660085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:18.674013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:18.674761 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:18.676402 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:18.677293 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:18.947384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:18.961425 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:18.963558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:18.972883 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-825bddd3-bd01-474d-b9a9-0c0ff08a3634 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.320275 Jan 31 17:16:18.974322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 549/1189] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:18 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:19.998137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:19.999179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:20.018243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.018934 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.020030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.027259 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:20.028258 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:20.041374 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.047552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.048376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.050229 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.050986 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.118038 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-369b43e1-22ac-488d-8c25-b581c99d7925 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101361 Jan 31 17:16:20.119024 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 550/1190] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:16:20 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 31 17:16:20.342787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:20.343689 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:20.354051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:20.354730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.355285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.356228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.356684 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.370646 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:20.372658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:20.374921 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-26d8d845-ae32-4462-a5c4-113dd98c70de tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.383574 Jan 31 17:16:20.376196 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 641/1191] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:19 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:20.409268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-e9e37222-3694-444b-8b62-c3c249ef76a0 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075824 Jan 31 17:16:20.417107 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 551/1192] 10.222.0.91 () {58 vars in 1301 bytes} [Mon Jan 31 17:16:20 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 31 17:16:20.511271 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:20.515596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:20.527186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.527971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.528839 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.529287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.572517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Going to try to terminate instance {{(pid=116483) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:16:20.721494 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cce361d2-b9bb-40ee-8868-37ea852b0309 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 204 len: 0 microversion: 2.1 time: 0.214501 Jan 31 17:16:20.722313 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 642/1193] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:16:20 2022] DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:16:20.740532 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:20.742896 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:20.752245 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.752874 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.753834 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:20.754887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:20.984587 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:20.995262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ce03d26c-9fbf-490b-af10-59585c2d26ab tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1671 microversion: 2.1 time: 0.261719 Jan 31 17:16:21.008673 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 552/1194] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:20 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1671 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:21.401576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:21.402126 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:21.410626 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:21.411230 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:21.412286 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:21.413620 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:21.599139 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:21.613152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:21.616373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:21.619622 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-90f67cd0-ca6a-456e-99e9-119bd09f59d7 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1738 microversion: 2.20 time: 0.223359 Jan 31 17:16:21.622309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 643/1195] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:21 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:22.018170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:22.019184 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:22.030813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:22.031558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:22.032983 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:22.033701 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:22.233247 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:22.246025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c0b80023-49d9-42c7-a615-924b698dd37b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1671 microversion: 2.1 time: 0.233921 Jan 31 17:16:22.246627 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 553/1196] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:22 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:22.647051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:22.647997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:22.656837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:22.657735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:22.659186 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:22.660292 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:22.955021 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:22.967827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:22.970310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:22.973566 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3c6439c2-1fef-495d-9dbf-26270db05d09 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1720 microversion: 2.20 time: 0.330687 Jan 31 17:16:22.980611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 644/1197] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:22 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1720 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:23.296497 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:23.298226 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:23.314287 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:23.315408 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:23.318217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:23.319430 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:23.553354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:23.569995 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-128ccf92-3246-472c-b007-c6e0d225be41 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1671 microversion: 2.1 time: 0.277544 Jan 31 17:16:23.570700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 554/1198] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:23 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1671 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:24.005850 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:24.006871 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:24.018033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:24.018813 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:24.020252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:24.021020 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:24.250913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:24.264465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:24.267224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:24.269303 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-30bab096-387d-471a-83e2-8554111c76a5 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1720 microversion: 2.20 time: 0.268929 Jan 31 17:16:24.270175 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 645/1199] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:23 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1720 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:24.597562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:24.598176 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:24.609014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:24.611878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:24.613490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:24.614354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:24.831169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:24.848217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3fc9376a-06e5-47c2-a99d-6b021accfad9 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1671 microversion: 2.1 time: 0.256256 Jan 31 17:16:24.849974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 555/1200] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:24 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:25.293859 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:25.294834 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:25.305712 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:25.306262 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:25.310034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:25.310034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:25.551897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:25.566755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:25.570200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:25.571594 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-91136f9e-377c-4802-bd3c-20c8870fe6ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1720 microversion: 2.20 time: 0.284487 Jan 31 17:16:25.573408 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 646/1201] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:25 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1720 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:25.874867 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:25.875930 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:25.888231 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:25.889025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:25.890414 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:25.891169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:26.016424 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:26.028719 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-089ce779-f653-46df-bad9-3b484bec4d4f tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1604 microversion: 2.1 time: 0.161036 Jan 31 17:16:26.030940 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 556/1202] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:25 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:26.038647 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-46368e8f-74c8-4179-a872-f83225298a02 req-1a1ad233-ed0e-49b4-9441-ab5cfdfe3cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "name": "network-vif-unplugged", "status": "completed", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:26.041862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:16:26.041862 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:16:26.054336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-46368e8f-74c8-4179-a872-f83225298a02 req-1a1ad233-ed0e-49b4-9441-ab5cfdfe3cf5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:26.055421 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-46368e8f-74c8-4179-a872-f83225298a02 req-1a1ad233-ed0e-49b4-9441-ab5cfdfe3cf5 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:26.073465 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-46368e8f-74c8-4179-a872-f83225298a02 req-1a1ad233-ed0e-49b4-9441-ab5cfdfe3cf5 service nova] Creating event network-vif-unplugged:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:16:26.082286 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-46368e8f-74c8-4179-a872-f83225298a02 req-1a1ad233-ed0e-49b4-9441-ab5cfdfe3cf5 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054738 Jan 31 17:16:26.083629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 647/1203] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:26.270894 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-78b386c1-28a8-4225-8124-548c7be4e351 req-98882583-26f7-4c22-92ee-9e28c2bf7f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595", "name": "network-vif-deleted", "tag": "72470c93-0a77-4ff0-9bbd-a0814537721e"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:26.275552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:16:26.275552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:16:26.290248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-78b386c1-28a8-4225-8124-548c7be4e351 req-98882583-26f7-4c22-92ee-9e28c2bf7f3e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:26.290985 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-78b386c1-28a8-4225-8124-548c7be4e351 req-98882583-26f7-4c22-92ee-9e28c2bf7f3e service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:26.322676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-78b386c1-28a8-4225-8124-548c7be4e351 req-98882583-26f7-4c22-92ee-9e28c2bf7f3e service nova] Creating event network-vif-deleted:72470c93-0a77-4ff0-9bbd-a0814537721e for instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 on hv-cinder-81566 Jan 31 17:16:26.330124 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-78b386c1-28a8-4225-8124-548c7be4e351 req-98882583-26f7-4c22-92ee-9e28c2bf7f3e service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063971 Jan 31 17:16:26.331237 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 557/1204] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:26.603886 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:26.605195 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:26.616198 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:26.617559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:26.619529 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:26.620094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:26.863524 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:26.879400 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:26.882600 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:26.884776 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0d0c301f-10ec-4585-b7a6-59b427886c00 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1720 microversion: 2.20 time: 0.289956 Jan 31 17:16:26.885596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 648/1205] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:26 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:27.062266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:27.063451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:27.083377 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:27.084218 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:27.085954 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:27.087041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:27.138385 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:27.138828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:27.139322 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lazy-loading 'fault' on Instance uuid 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:16:27.214724 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0edd35fd91c045238a8e7a65bec256cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec95f59938f64b62adb4e61d7b12c80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:27.233372 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5403ab00-5504-4e6e-8d09-850c5fd414ac tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 200 len: 1326 microversion: 2.1 time: 0.177177 Jan 31 17:16:27.234446 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 558/1206] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:27 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 1326 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:27.915157 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:27.915925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:27.925742 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:27.926518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:27.927905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:27.928855 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:28.139636 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:28.153059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:28.155085 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:28.155618 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b51da247-0b93-4f4b-935b-76c8dba941f6 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1663 microversion: 2.20 time: 0.246525 Jan 31 17:16:28.156285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 649/1207] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:27 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1663 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:28.175748 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c4443d6-64b7-4c97-bf6a-249e54513ec0"}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:28.177182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:28.185234 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:28.185738 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:28.186652 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:28.187296 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:28.259975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:28.260794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:28.271287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:28.272287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:28.273553 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:28.274276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:28.299490 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] HTTP exception thrown: Instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 could not be found. Jan 31 17:16:28.300423 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Returning 404 to user: Instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:16:28.301596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-025729c7-913f-45d1-a839-d807b9bde373 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 404 len: 111 microversion: 2.1 time: 0.048442 Jan 31 17:16:28.302166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 650/1208] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:28 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:16:28.316635 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-bdbf0a08-bc85-43c5-a4a5-a2f3cb78011c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '.version_select at 0x7fdce26e3280>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:28.351353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-bdbf0a08-bc85-43c5-a4a5-a2f3cb78011c tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433836516" status: 202 len: 0 microversion: 2.1 time: 0.040560 Jan 31 17:16:28.353011 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 651/1209] 10.222.0.91 () {58 vars in 1217 bytes} [Mon Jan 31 17:16:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433836516 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 31 17:16:28.654947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0739cefa-5def-4773-9af3-4a45edeac80e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.483572 Jan 31 17:16:28.656351 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 559/1210] 10.222.0.91 () {62 vars in 1363 bytes} [Mon Jan 31 17:16:28 2022] POST /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-volume_attachments => generated 188 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 31 17:16:28.863431 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:28.864584 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:28.874220 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:28.874835 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:28.875799 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:28.876413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:29.309879 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2f102943-1fd9-4585-85cf-f57bd5b93155 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-volume_attachments/2c4443d6-64b7-4c97-bf6a-249e54513ec0" status: 202 len: 0 microversion: 2.20 time: 0.452842 Jan 31 17:16:29.316800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 652/1211] 10.222.0.91 () {60 vars in 1456 bytes} [Mon Jan 31 17:16:28 2022] DELETE /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-volume_attachments/2c4443d6-64b7-4c97-bf6a-249e54513ec0 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:16:29.395944 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:29.396911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:29.404736 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:29.405195 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:29.406039 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:29.406445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:29.587362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5be78cfd-a241-4bed-b95f-7a8be0c46964 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "POST /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/action" status: 202 len: 0 microversion: 2.20 time: 0.195872 Jan 31 17:16:29.588369 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 560/1212] 10.222.0.91 () {62 vars in 1318 bytes} [Mon Jan 31 17:16:29 2022] POST /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 31 17:16:29.601637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:29.602497 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:29.611694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:29.612243 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:29.613111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:29.613632 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:29.864850 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:29.880396 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:29.883022 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:29.884413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5f237a5b-151c-46f8-822f-c71fa46594ee tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1671 microversion: 2.20 time: 0.289528 Jan 31 17:16:29.885238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 653/1213] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:29 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:30.921493 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:30.923735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:30.938138 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:30.939014 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:30.941151 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:30.942164 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:31.166507 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:31.182036 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:31.183994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:31.185845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-56676153-b19b-4d5f-8aff-dc68b816f606 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1673 microversion: 2.20 time: 0.274339 Jan 31 17:16:31.186873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 561/1214] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:30 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:31.852929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:31.853858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:31.866581 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:31.867058 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:31.868423 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:31.869112 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:31.894692 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] HTTP exception thrown: Instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 could not be found. Jan 31 17:16:31.896427 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Returning 404 to user: Instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:16:31.899217 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d61b3062-42f6-4b37-9940-bc4dd5b6780b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 404 len: 111 microversion: 2.1 time: 0.051413 Jan 31 17:16:31.899786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 654/1215] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:16:31 2022] DELETE /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:16:31.913716 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:31.914415 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:31.923479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:31.925096 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:31.926763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:31.927489 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:31.949654 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] HTTP exception thrown: Instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 could not be found. Jan 31 17:16:31.951188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Returning 404 to user: Instance 8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:16:31.953371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-42272429-af74-46af-b996-c9558c8a3226 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595" status: 404 len: 111 microversion: 2.1 time: 0.046587 Jan 31 17:16:31.953979 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 562/1216] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:31 2022] GET /compute/v2.1/servers/8e19a3eb-e2ed-4525-a1b2-3d7ec58e5595 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:16:32.113149 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1844303368", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1962695943", "security_groups": [{"name": "tempest-secgroup-smoke-187526338"}], "block_device_mapping_v2": [{"uuid": "24672cb6-a00f-49d3-955b-380f72c79f3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3410a9f-2a7c-45fe-a775-4b87760d2a32"}]}} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:32.223055 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:32.231153 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:32.242302 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:32.242854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:32.244494 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:32.245366 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:32.317305 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.network.neutron [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] validate_networks() for [('c3410a9f-2a7c-45fe-a775-4b87760d2a32', None, None, None, None, None)] {{(pid=116483) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:16:32.617978 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:32.630009 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:32.633747 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:32.636251 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f3fa86eb-88d8-4975-9022-67c1e645ec8e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.423754 Jan 31 17:16:32.636871 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 563/1217] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:32 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:33.029328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Flavor limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:16:33.030052 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Image limits 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:16:33.030352 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Flavor pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:16:33.030817 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Image pref 0:0:0 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:16:33.031281 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.virt.hardware [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116483) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:16:33.051967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.052523 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.054196 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.055046 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.079526 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for project 0070c6d36b294fcd87adac6ded40165c. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:16:33.085118 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.quota [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for user e2b3b1f45d1b4b4995bad98ce0236b07 and project 0070c6d36b294fcd87adac6ded40165c. Resources: {'cores', 'instances', 'ram'} {{(pid=116483) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:16:33.170253 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Going to run 1 instances... {{(pid=116483) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:16:33.172621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24672cb6-a00f-49d3-955b-380f72c79f3f',volume_size=None,volume_type=None)] {{(pid=116483) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:16:33.192248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:33.194048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:33.201912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.202508 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.203682 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.204394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.223365 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] HTTP exception thrown: Instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 could not be found. Jan 31 17:16:33.224792 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Returning 404 to user: Instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:16:33.226387 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ef875564-fc0f-434b-abc6-769494feb5b2 tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "DELETE /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 404 len: 111 microversion: 2.1 time: 0.040312 Jan 31 17:16:33.227282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 564/1218] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:16:33 2022] DELETE /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:16:33.239188 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:33.239780 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] [instance: 578b3d82-02e9-4759-b0e3-ad4ff650a4c4] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:33.250429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.251240 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.253525 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.254318 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.281115 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] HTTP exception thrown: Instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 could not be found. Jan 31 17:16:33.281961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] Returning 404 to user: Instance 578b3d82-02e9-4759-b0e3-ad4ff650a4c4 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:16:33.283149 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a72ee863-ac09-4169-91f1-96ee0249fa5b tempest-AttachVolumeTestJSON-1646778014 tempest-AttachVolumeTestJSON-1646778014-project] 10.222.0.91 "GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4" status: 404 len: 111 microversion: 2.1 time: 0.050784 Jan 31 17:16:33.283880 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 565/1219] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:33 2022] GET /compute/v2.1/servers/578b3d82-02e9-4759-b0e3-ad4ff650a4c4 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 31 17:16:33.403406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f8a54894-bb21-42a9-8973-ff1533c37147 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.296473 Jan 31 17:16:33.404690 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 655/1220] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:16:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 31 17:16:33.420622 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-2a0eacbe-6959-4a80-b276-a416f64e5b1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:33.421552 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-2a0eacbe-6959-4a80-b276-a416f64e5b1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:33.509891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-2a0eacbe-6959-4a80-b276-a416f64e5b1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:33.523396 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-2a0eacbe-6959-4a80-b276-a416f64e5b1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1095 microversion: 2.1 time: 0.110378 Jan 31 17:16:33.537381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 566/1221] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:33 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:33.674404 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:33.680289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:33.718637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.719414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:33.721000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:33.722078 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:34.158656 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:34.182385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:34.186218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:34.189253 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a225152c-cb14-4e13-992f-31b1f72357f3 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.523637 Jan 31 17:16:34.204159 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 656/1222] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:33 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:34.566101 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:34.566862 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:34.586355 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:34.587594 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:34.588972 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:34.589911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:34.758663 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:34.777064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-43aee16c-6042-42ff-bd97-76262714ae9b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.214475 Jan 31 17:16:34.778085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 567/1223] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:34 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:35.215295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:35.217616 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:35.239092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:35.240240 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:35.242143 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:35.243224 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:35.586309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:35.596567 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:35.598343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:35.601588 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d4d95e43-ad6c-41d2-98ca-bcf89e8c33be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.392026 Jan 31 17:16:35.610244 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 657/1224] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:35 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:35.808856 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:35.810244 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:35.818164 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:35.819417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:35.821733 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:35.822623 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:35.954555 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:35.969791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-eb600367-83b3-48a2-804b-7c79c979848e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.165116 Jan 31 17:16:35.971516 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 568/1225] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:35 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:36.629072 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:36.631854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:36.644517 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:36.645784 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:36.647619 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:36.648760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:36.897413 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:36.908582 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:36.912177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:36.914909 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c3cf51e6-38cb-49a8-bc5f-f3e14ace8243 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.291176 Jan 31 17:16:36.927884 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 658/1226] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:36 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:36.999720 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:37.000933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:37.012742 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:37.013310 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:37.014349 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:37.015081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:37.125910 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:37.140708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-35c33122-1903-493b-a755-1b5d2bbe7e05 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.147355 Jan 31 17:16:37.141844 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 569/1227] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:36 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:37.939318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:37.940193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:37.951768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:37.952899 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:37.954479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:37.955824 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:38.169962 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:38.170787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:38.202676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:38.203542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:38.204852 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:38.205492 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:38.409592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:38.435889 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:38.455236 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:38.458913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8151b705-e2eb-4609-8947-4e37af0cdf9c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.524464 Jan 31 17:16:38.461750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 659/1228] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:37 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:38.496836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:38.520065 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4ec4534c-ea7f-4b14-a0f8-28c36614b175 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.355296 Jan 31 17:16:38.522416 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 570/1229] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:38 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:39.501097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:39.505177 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:39.524674 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:39.525521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:39.530821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:39.530821 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:39.549399 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:39.550458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:39.580762 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:39.581288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:39.582702 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:39.583380 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:39.872357 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:39.920248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5108f665-f961-4d72-abeb-503ab4cd3990 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.379160 Jan 31 17:16:39.941577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 571/1230] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:39 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:40.115803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:40.140241 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:40.145334 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:40.148750 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-53642423-685b-47f5-90db-15bd17d2b36c tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.661426 Jan 31 17:16:40.150611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 660/1231] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:39 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:40.971763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:40.971763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:40.987461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:40.988484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:40.992749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:40.993785 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:41.102376 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:41.120426 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3d6f1b7f-47a7-4ae5-93b3-cd00cfca951e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.156230 Jan 31 17:16:41.121567 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 572/1232] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:40 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:41.188675 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:41.189685 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:41.205510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:41.206275 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:41.207355 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:41.208134 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:41.503344 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:41.519778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:41.522678 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:41.525132 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fbe18700-af4c-485d-ad94-5505bfea1029 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.344704 Jan 31 17:16:41.526341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 661/1233] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:41 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:42.153162 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:42.155428 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:42.168718 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:42.169911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:42.171744 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:42.172617 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:42.276413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:42.286314 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bc1f9b68-8cc8-4b73-b45f-a7fb5bc01751 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.143903 Jan 31 17:16:42.293441 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 573/1234] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:42 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:42.550698 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:42.551971 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:42.559880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:42.560522 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:42.561454 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:42.562020 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:42.872165 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:42.895720 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:42.902147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:42.905338 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8c02712e-9475-49b7-a315-b82425a731dd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.359010 Jan 31 17:16:42.906166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 662/1235] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:42 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:43.313940 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:43.324700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:43.334729 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:43.335449 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:43.339834 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:43.339834 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:43.462320 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:43.472647 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c968bb90-6958-44cb-926a-51eb902f1071 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.164910 Jan 31 17:16:43.484139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 574/1236] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:43 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:43.939719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:43.941342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:43.957142 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:43.957607 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:43.958439 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:43.958966 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:44.245755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:44.271074 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:44.280357 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:44.281897 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-94dd3889-ba44-47a3-8e20-1b23214953ac tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.351534 Jan 31 17:16:44.283314 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 663/1237] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:43 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:44.504727 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:44.507987 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:44.520973 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:44.521882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:44.523266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:44.524161 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:44.647288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:44.656636 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4f067653-88d1-41fd-b6b8-114a53588d7c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.160237 Jan 31 17:16:44.657879 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 575/1238] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:44 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:45.312840 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:45.314924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:45.325586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:45.326542 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:45.327615 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:45.328332 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:45.661450 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:45.673511 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:45.676657 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:45.679310 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-580b50de-53dd-4566-be83-4907adfd6799 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.370317 Jan 31 17:16:45.680662 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 664/1239] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:45 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:45.692484 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:45.695259 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:45.718200 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:45.724878 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:45.726265 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:45.727042 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:46.138669 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:46.159487 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ad9bec82-557d-417f-8d0f-cc4af482ef2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1145 microversion: 2.1 time: 0.473379 Jan 31 17:16:46.160980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 576/1240] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:45 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1145 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:46.712693 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:46.712693 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:46.727125 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:46.728160 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:46.729909 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:46.730637 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:47.002975 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:47.016827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:47.019444 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:47.021137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4ad0598d-7824-4d82-b621-b53dc21d43be tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.316130 Jan 31 17:16:47.022762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 665/1241] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:46 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:47.186171 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:47.187044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:47.193882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:47.194334 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:47.195246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:47.195683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:47.288367 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:47.300749 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dca47d07-bce3-4a10-920d-8a0c4ffb063a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1193 microversion: 2.1 time: 0.119587 Jan 31 17:16:47.301913 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 577/1242] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:47 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:48.045960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:48.046744 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:48.059551 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:48.060234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:48.062101 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:48.062825 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:48.270582 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:48.282045 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:48.284541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:48.286430 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-189550f6-d6c9-4243-9f1d-2b901e040272 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.247545 Jan 31 17:16:48.287949 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 666/1243] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:48 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:48.323167 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:48.323855 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:48.331363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:48.332163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:48.333818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:48.334424 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:48.434891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:48.452041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d669b7a5-a9af-40c1-892b-849a55902eb4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1211 microversion: 2.1 time: 0.134429 Jan 31 17:16:48.452941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 578/1244] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:48 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:49.323964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:49.325912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:49.338063 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:49.338832 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:49.340447 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:49.341469 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:49.475977 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:49.477044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:49.487177 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:49.487970 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:49.489546 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:49.491064 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:49.647330 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:49.662007 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:49.667369 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:49.670724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ecc1a5fa-1619-45df-8d3d-2d33f9b1751f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.356721 Jan 31 17:16:49.678123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 667/1245] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:49 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:49.776097 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:49.792264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-70d409db-0c42-47ea-9aa4-f54c6892b302 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.320667 Jan 31 17:16:49.793207 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 579/1246] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:49 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:50.176885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-289c54f6-6ce7-459e-b6f0-8ecfac806da9 req-8379beee-d00f-4bf1-a189-d50f4213fdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa5ce45-657d-4aa3-aa1a-130457329fb7", "tag": "b3738a13-04f7-44a8-ac50-ef54498f598e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:50.185965 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:16:50.185965 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:16:50.230534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-289c54f6-6ce7-459e-b6f0-8ecfac806da9 req-8379beee-d00f-4bf1-a189-d50f4213fdc0 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:50.231467 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-289c54f6-6ce7-459e-b6f0-8ecfac806da9 req-8379beee-d00f-4bf1-a189-d50f4213fdc0 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:50.258768 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-289c54f6-6ce7-459e-b6f0-8ecfac806da9 req-8379beee-d00f-4bf1-a189-d50f4213fdc0 service nova] Creating event network-changed:b3738a13-04f7-44a8-ac50-ef54498f598e for instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 on hv-cinder-81566 Jan 31 17:16:50.283265 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-289c54f6-6ce7-459e-b6f0-8ecfac806da9 req-8379beee-d00f-4bf1-a189-d50f4213fdc0 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115760 Jan 31 17:16:50.284209 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 668/1247] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:50.708952 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:50.709757 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:50.718746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:50.719230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:50.720625 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:50.721332 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:50.826534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:50.831604 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:50.847534 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:50.850289 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:50.851876 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:50.853448 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:51.063557 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:51.077073 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:51.080791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:51.082917 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3f99a998-2836-45f2-8439-5fa79a39d756 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.379885 Jan 31 17:16:51.085873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 580/1248] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:50 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:51.169609 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:51.181203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-3a679726-dc2c-46a4-b3c1-0a1e089ef00d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.363409 Jan 31 17:16:51.182215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 669/1249] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:50 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:52.116884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:52.122947 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:52.144163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:52.144163 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:52.145023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:52.145712 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:52.201778 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:52.202787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:52.218992 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:52.219910 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:52.221341 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:52.221988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:52.569977 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:52.581072 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:52.584283 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:52.587132 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-32f4c815-cc96-4a1b-8ac3-4d03b9a1beed tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.483245 Jan 31 17:16:52.588199 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 581/1250] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:52 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:52.597034 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-2de58ea5-48ff-4402-b73a-f4218b6fb2a6 req-9e6b393d-85cf-4788-844b-2e94f4229363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "name": "network-vif-plugged", "status": "completed", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:16:52.601189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:16:52.601189 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:16:52.611888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:52.616299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-2de58ea5-48ff-4402-b73a-f4218b6fb2a6 req-9e6b393d-85cf-4788-844b-2e94f4229363 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:52.617643 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-2de58ea5-48ff-4402-b73a-f4218b6fb2a6 req-9e6b393d-85cf-4788-844b-2e94f4229363 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:52.638492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4a5cf6ae-6156-4270-8562-9e6ea8ed01ee tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.429256 Jan 31 17:16:52.638492 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 670/1251] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:52 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:52.655641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-2de58ea5-48ff-4402-b73a-f4218b6fb2a6 req-9e6b393d-85cf-4788-844b-2e94f4229363 service nova] Creating event network-vif-plugged:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:16:52.666578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-2de58ea5-48ff-4402-b73a-f4218b6fb2a6 req-9e6b393d-85cf-4788-844b-2e94f4229363 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074543 Jan 31 17:16:52.666578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 582/1252] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:16:53.623804 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:53.624860 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:53.647474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:53.648499 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:53.649916 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:53.650686 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:53.659150 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:53.659850 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:53.673422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:53.674490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:53.676462 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:53.678339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:53.954680 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:53.973580 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:53.976426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:53.977833 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-728c003a-6b92-4467-ba26-cb3c9c2d357b tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.359433 Jan 31 17:16:53.978496 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 671/1253] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:53 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:54.006706 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:54.026394 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-65fc422e-02b0-477d-b0ed-61570813b42f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.375078 Jan 31 17:16:54.027397 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 583/1254] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:53 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:55.019312 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:55.020686 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:55.029905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:55.031147 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:55.031973 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:55.032455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:55.060589 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:55.063157 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:55.078362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:55.080539 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:55.082618 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:55.083750 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:55.426961 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:55.444167 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:55.447679 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:55.451958 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-69b410cc-e748-4cc3-ad56-e3e71086298a tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1729 microversion: 2.20 time: 0.436939 Jan 31 17:16:55.453988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 672/1255] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:55 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1729 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:16:55.501899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:55.518466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-c30812fd-d996-49c4-9fbb-ee1ca85f3980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.470299 Jan 31 17:16:55.520041 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 584/1256] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:55 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:16:56.484357 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:56.485373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:56.497880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:56.498385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:56.499455 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:56.499967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:56.563518 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:56.564704 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:56.575491 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:56.585903 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:56.587736 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:56.588563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:56.754399 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:56.772308 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:56.785442 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:56.788571 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2a4da818-6c06-4ab3-812b-043db2fb3a68 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1716 microversion: 2.20 time: 0.310888 Jan 31 17:16:56.790233 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 673/1257] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:16:56 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1716 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:16:56.891310 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:56.904815 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a75e31f7-ab19-4159-b905-071291a12dc7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.362628 Jan 31 17:16:56.905818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 585/1258] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:56 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:57.928218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:57.929367 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:57.938925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:57.938925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:57.939819 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:57.940309 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:58.174980 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:58.186858 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-423a290d-15df-433d-9d8e-3656ec3f1498 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.265817 Jan 31 17:16:58.187783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 674/1259] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:57 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:16:59.210023 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:16:59.210897 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:16:59.220527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:59.221141 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:59.222439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:16:59.223186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:16:59.451938 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:16:59.465305 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-110c21d1-096f-4318-9bc1-ca8ce7facffc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.261019 Jan 31 17:16:59.466246 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 586/1260] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:16:59 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:00.486025 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:00.486703 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:00.502123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:00.502894 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:00.504507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:00.505592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:00.764393 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:00.779451 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d5f4f675-65ea-4888-985a-7091e7d2cb03 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.297047 Jan 31 17:17:00.780597 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 675/1261] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:00 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:01.803944 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:01.804711 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:01.813582 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:01.814483 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:01.815898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:01.816909 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:02.064465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:02.082448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-cd07332a-a7de-45f5-849a-e4801653c7b0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.281079 Jan 31 17:17:02.083519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 587/1262] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:01 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:02.300434 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-e66dcf3c-ecb6-450c-ba73-587ca5018837 req-1de3a2d9-dd2a-4252-8735-da44af244282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa5ce45-657d-4aa3-aa1a-130457329fb7", "name": "network-vif-plugged", "status": "completed", "tag": "b3738a13-04f7-44a8-ac50-ef54498f598e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:17:02.305794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:17:02.305794 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:17:02.326788 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-e66dcf3c-ecb6-450c-ba73-587ca5018837 req-1de3a2d9-dd2a-4252-8735-da44af244282 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:02.327836 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-e66dcf3c-ecb6-450c-ba73-587ca5018837 req-1de3a2d9-dd2a-4252-8735-da44af244282 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:02.353474 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-e66dcf3c-ecb6-450c-ba73-587ca5018837 req-1de3a2d9-dd2a-4252-8735-da44af244282 service nova] Creating event network-vif-plugged:b3738a13-04f7-44a8-ac50-ef54498f598e for instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 on hv-cinder-81566 Jan 31 17:17:02.359913 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-e66dcf3c-ecb6-450c-ba73-587ca5018837 req-1de3a2d9-dd2a-4252-8735-da44af244282 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067296 Jan 31 17:17:02.361051 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 676/1263] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:17:03.112873 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:03.114212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:03.126791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:03.127546 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:03.128655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:03.129496 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:03.371025 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:03.383461 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5950df91-9f63-409f-b77c-a40cbdf2e0ac tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.277320 Jan 31 17:17:03.384882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 588/1264] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:03 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:04.406328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:04.407111 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:04.417586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:04.418083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:04.418910 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:04.419358 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:04.603612 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:04.616890 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7ab99d6d-3578-4011-b2dc-19a9bcbc89ce tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1266 microversion: 2.1 time: 0.214171 Jan 31 17:17:04.617785 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 677/1265] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:04 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:05.636719 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:05.637512 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:05.646569 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:05.647112 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:05.647825 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:05.648288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:05.895230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:05.905755 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0a232f0e-7db1-41b3-9744-00c8e3d04530 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1454 microversion: 2.1 time: 0.273627 Jan 31 17:17:05.906421 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 589/1266] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:05 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1454 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:05.929888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:05.930919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:05.940504 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:05.941097 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:05.942218 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:05.943166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:06.212251 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:06.224867 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cd90d984-4f5a-436f-95a9-e74c814fd3aa tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1454 microversion: 2.1 time: 0.303022 Jan 31 17:17:06.226114 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 678/1267] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:05 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1454 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:08.702609 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-c5182dd2-1721-4d60-ae50-1a968cf0c2ee req-e31be555-7a2c-4484-bdf8-586b24d5aeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa5ce45-657d-4aa3-aa1a-130457329fb7", "tag": "b3738a13-04f7-44a8-ac50-ef54498f598e"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:17:08.707017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:17:08.707017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:17:08.719616 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-c5182dd2-1721-4d60-ae50-1a968cf0c2ee req-e31be555-7a2c-4484-bdf8-586b24d5aeb7 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:08.720288 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-c5182dd2-1721-4d60-ae50-1a968cf0c2ee req-e31be555-7a2c-4484-bdf8-586b24d5aeb7 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:08.736839 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-c5182dd2-1721-4d60-ae50-1a968cf0c2ee req-e31be555-7a2c-4484-bdf8-586b24d5aeb7 service nova] Creating event network-changed:b3738a13-04f7-44a8-ac50-ef54498f598e for instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 on hv-cinder-81566 Jan 31 17:17:08.743645 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-c5182dd2-1721-4d60-ae50-1a968cf0c2ee req-e31be555-7a2c-4484-bdf8-586b24d5aeb7 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045859 Jan 31 17:17:08.744657 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 590/1268] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:17:27.003988 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:27.005755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:27.013606 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:27.014598 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:27.015589 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:27.016068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:27.026316 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-765aa5d4-222a-49a7-b71b-a0a19a2893c7 req-1a428752-d627-44e1-9a93-78c8552646e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:17:27.027911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:17:27.027911 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:17:27.037417 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-765aa5d4-222a-49a7-b71b-a0a19a2893c7 req-1a428752-d627-44e1-9a93-78c8552646e1 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:27.037865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-765aa5d4-222a-49a7-b71b-a0a19a2893c7 req-1a428752-d627-44e1-9a93-78c8552646e1 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:27.049059 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Going to try to terminate instance {{(pid=116483) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:17:27.052284 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-765aa5d4-222a-49a7-b71b-a0a19a2893c7 req-1a428752-d627-44e1-9a93-78c8552646e1 service nova] Creating event network-changed:e7ff3fe5-09f9-4881-8621-ae4162f6a416 for instance 4cada1e7-b97c-481f-bb74-31b3721ef746 on hv-cinder-81566 Jan 31 17:17:27.060309 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-765aa5d4-222a-49a7-b71b-a0a19a2893c7 req-1a428752-d627-44e1-9a93-78c8552646e1 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050272 Jan 31 17:17:27.061170 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 591/1269] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:17:27.144237 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-c6730806-e2cb-43d4-8700-2cd3926f71d5 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "DELETE /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 204 len: 0 microversion: 2.1 time: 0.144324 Jan 31 17:17:27.150061 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 679/1270] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:17:26 2022] DELETE /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:17:27.158836 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:27.160787 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:27.168444 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:27.169384 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:27.170561 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:27.171169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:27.577154 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:27.590509 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bcafa938-8e63-4da4-a922-bc364297d9ed tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1565 microversion: 2.1 time: 0.438429 Jan 31 17:17:27.591143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 592/1271] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:27 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1565 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:28.616216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:28.616885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:28.623666 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:28.624379 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:28.625033 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:28.625498 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:28.842030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:28.850740 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8fdf8727-87db-4cd1-bc37-fd616edf94a6 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1448 microversion: 2.1 time: 0.241291 Jan 31 17:17:28.851326 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 680/1272] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:28 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1448 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:29.871722 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:29.872630 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:29.883081 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:29.883771 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:29.885130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:29.885798 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:30.039522 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:30.052205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3a467591-85fd-42a4-a761-78250c74a383 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1448 microversion: 2.1 time: 0.186797 Jan 31 17:17:30.052818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 593/1273] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:29 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1448 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:30.573008 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-5e6e83bb-7e25-4020-83e7-9464d4f81a93 req-0d1c637e-99b1-4b49-bc30-4b62fdc309f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cada1e7-b97c-481f-bb74-31b3721ef746", "name": "network-vif-deleted", "tag": "e7ff3fe5-09f9-4881-8621-ae4162f6a416"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:17:30.575221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:17:30.575221 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:17:30.583611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-5e6e83bb-7e25-4020-83e7-9464d4f81a93 req-0d1c637e-99b1-4b49-bc30-4b62fdc309f2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:30.584065 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-5e6e83bb-7e25-4020-83e7-9464d4f81a93 req-0d1c637e-99b1-4b49-bc30-4b62fdc309f2 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:30.595130 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-5e6e83bb-7e25-4020-83e7-9464d4f81a93 req-0d1c637e-99b1-4b49-bc30-4b62fdc309f2 service nova] Creating event network-vif-deleted:e7ff3fe5-09f9-4881-8621-ae4162f6a416 for instance 4cada1e7-b97c-481f-bb74-31b3721ef746 on hv-cinder-81566 Jan 31 17:17:30.600980 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-5e6e83bb-7e25-4020-83e7-9464d4f81a93 req-0d1c637e-99b1-4b49-bc30-4b62fdc309f2 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Jan 31 17:17:30.601826 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 681/1274] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:17:31.069464 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:31.070085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:31.076527 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:31.076981 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:31.077778 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:31.078219 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:31.147278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d79ec01357e4f48bbe83852d2871d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef9d07877504c04a9a1062d34b7a80b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:31.154982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-750a4211-4b10-4bf4-915c-e51a5d1a3058 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 200 len: 1219 microversion: 2.1 time: 0.089261 Jan 31 17:17:31.155563 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 594/1275] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:31 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:17:32.173796 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:32.174493 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] [instance: 4cada1e7-b97c-481f-bb74-31b3721ef746] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:32.181955 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:32.182406 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:32.183203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:32.183645 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:32.197790 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] HTTP exception thrown: Instance 4cada1e7-b97c-481f-bb74-31b3721ef746 could not be found. Jan 31 17:17:32.198402 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Returning 404 to user: Instance 4cada1e7-b97c-481f-bb74-31b3721ef746 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:17:32.199255 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1994c539-55b1-45ee-9858-c80fc75bdcc0 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746" status: 404 len: 111 microversion: 2.1 time: 0.030108 Jan 31 17:17:32.199815 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 682/1276] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:17:32 2022] GET /compute/v2.1/servers/4cada1e7-b97c-481f-bb74-31b3721ef746 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:17:32.370403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-dc318435-d051-4ff4-9b03-0d3824bb3543 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] Calling method '.version_select at 0x7fdce2901dc0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:32.397248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-dc318435-d051-4ff4-9b03-0d3824bb3543 tempest-TestShelveInstance-332658889 tempest-TestShelveInstance-332658889-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1997291081" status: 202 len: 0 microversion: 2.1 time: 0.030379 Jan 31 17:17:32.402412 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 595/1277] 10.222.0.91 () {58 vars in 1253 bytes} [Mon Jan 31 17:17:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1997291081 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:17:45.372207 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:45.373123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:45.380176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:45.380631 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:45.381420 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:45.381859 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:45.419760 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d19673b7-e650-40b9-bbee-174cddd09663 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053687 Jan 31 17:17:45.420419 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 683/1278] 10.222.0.91 () {60 vars in 1342 bytes} [Mon Jan 31 17:17:45 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:17:45.479898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:45.480624 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:45.488187 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:45.488791 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:45.489642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:45.490087 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:45.516131 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:17:45.613831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-68be10e4-5399-44d6-a1f3-b482166d6325 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 204 len: 0 microversion: 2.20 time: 0.136421 Jan 31 17:17:45.614605 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 596/1279] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Jan 31 17:17:45 2022] DELETE /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 31 17:17:45.629203 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:45.629820 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:45.635803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:45.636300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:45.637095 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:45.637535 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:45.790623 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:45.798950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:45.802086 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:45.803981 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5d703c0a-96c0-4647-a29a-8edf7d8b7c90 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.178840 Jan 31 17:17:45.804976 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 684/1280] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:45 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 31 17:17:46.823353 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:46.824269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:46.832140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:46.832600 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:46.833413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:46.833891 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:46.998966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:47.007579 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:47.009109 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:47.010266 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-eadadcc7-07f0-43fc-ae6b-b421e24ee1cf tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.191342 Jan 31 17:17:47.010843 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 597/1281] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:46 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:17:48.032786 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:48.033613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:48.039762 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:48.040318 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:48.041146 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:48.041595 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:48.207215 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:48.219576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:48.222155 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:48.223997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-92262804-cd1e-4a17-bcb8-18e87e2c557d tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.196379 Jan 31 17:17:48.224925 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 685/1282] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:48 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:17:49.247602 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:49.248252 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:49.255062 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:49.255575 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:49.256409 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:49.256899 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:49.413060 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:49.420986 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:49.422690 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:49.424044 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5f2632a6-6ede-4625-a939-af8e9a077a27 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.180198 Jan 31 17:17:49.425637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 598/1283] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:49 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:17:50.447219 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:50.448247 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:50.459062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:50.459888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:50.461304 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:50.462092 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:50.621384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:50.631556 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:50.634552 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:50.636731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-92e1e7e6-c8a1-47f2-9012-573ff653524f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1722 microversion: 2.20 time: 0.195895 Jan 31 17:17:50.637346 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 686/1284] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:50 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:17:51.658212 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:51.660854 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:51.671306 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:51.672182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:51.673088 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:51.673781 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:51.771442 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:51.783559 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:51.787737 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cae436f97f74de1bebd6c763867bfa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2ba1be78a47e4b1e70224544c7828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:17:51.789507 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-b4027620-52a8-4056-8c42-368f1f517cb0 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 200 len: 1654 microversion: 2.20 time: 0.138673 Jan 31 17:17:51.791041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 687/1285] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:51 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 1654 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 31 17:17:51.878730 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-1719bdb8-55d4-4b66-a3f0-625feeda003e req-c464a6f4-30d4-4ed4-80c9-1f728c88ab22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2850f1c6-52bb-46bf-acba-2fd62526c232", "name": "network-vif-deleted", "tag": "e12acd48-feab-4b7c-acb6-9582365d041a"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:17:51.882928 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:17:51.882928 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:17:51.896439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-1719bdb8-55d4-4b66-a3f0-625feeda003e req-c464a6f4-30d4-4ed4-80c9-1f728c88ab22 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:51.897371 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-1719bdb8-55d4-4b66-a3f0-625feeda003e req-c464a6f4-30d4-4ed4-80c9-1f728c88ab22 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:51.918496 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-1719bdb8-55d4-4b66-a3f0-625feeda003e req-c464a6f4-30d4-4ed4-80c9-1f728c88ab22 service nova] Creating event network-vif-deleted:e12acd48-feab-4b7c-acb6-9582365d041a for instance 2850f1c6-52bb-46bf-acba-2fd62526c232 on hv-cinder-81566 Jan 31 17:17:51.930538 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-1719bdb8-55d4-4b66-a3f0-625feeda003e req-c464a6f4-30d4-4ed4-80c9-1f728c88ab22 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281774 Jan 31 17:17:51.931244 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 599/1286] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:17:52.814466 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:52.815983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:52.828297 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:52.829182 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:52.830423 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:52.831216 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:52.848502 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] HTTP exception thrown: Instance 2850f1c6-52bb-46bf-acba-2fd62526c232 could not be found. Jan 31 17:17:52.849273 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Returning 404 to user: Instance 2850f1c6-52bb-46bf-acba-2fd62526c232 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:17:52.850259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fea33e06-c36e-4cfe-9ce8-c34669cf2680 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 404 len: 111 microversion: 2.20 time: 0.041758 Jan 31 17:17:52.850936 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 688/1287] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:52 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:17:52.860514 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-863ddcc8-0441-488c-8d27-feec418ed301 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '.version_select at 0x7fdce28a3af0>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:52.886833 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-863ddcc8-0441-488c-8d27-feec418ed301 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660067138" status: 204 len: 0 microversion: 2.20 time: 0.030992 Jan 31 17:17:52.887941 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 600/1288] 10.222.0.91 () {60 vars in 1258 bytes} [Mon Jan 31 17:17:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660067138 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 31 17:17:57.899123 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:57.900285 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:57.906489 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:57.906996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:57.907805 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:57.908302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:57.922688 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] HTTP exception thrown: Instance 2850f1c6-52bb-46bf-acba-2fd62526c232 could not be found. Jan 31 17:17:57.923323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Returning 404 to user: Instance 2850f1c6-52bb-46bf-acba-2fd62526c232 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:17:57.924200 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-17d4181c-c579-424e-89c5-731224a3b954 tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 404 len: 111 microversion: 2.20 time: 0.029445 Jan 31 17:17:57.925409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 689/1289] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Jan 31 17:17:57 2022] DELETE /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 31 17:17:57.939617 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:57.940436 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 2850f1c6-52bb-46bf-acba-2fd62526c232] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:57.947282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:57.947734 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:57.948554 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:57.949006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:57.964558 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] HTTP exception thrown: Instance 2850f1c6-52bb-46bf-acba-2fd62526c232 could not be found. Jan 31 17:17:57.965160 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Returning 404 to user: Instance 2850f1c6-52bb-46bf-acba-2fd62526c232 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:17:57.965999 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-a7344440-6917-48ab-b886-24bab0acebdd tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232" status: 404 len: 111 microversion: 2.20 time: 0.034509 Jan 31 17:17:57.966551 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 601/1290] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:57 2022] GET /compute/v2.1/servers/2850f1c6-52bb-46bf-acba-2fd62526c232 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:17:59.102774 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:59.103279 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:59.109694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:59.110152 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:59.110968 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:59.111407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:59.125612 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] HTTP exception thrown: Instance 7c80add9-d970-4aae-9ab5-6df59903b074 could not be found. Jan 31 17:17:59.126166 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Returning 404 to user: Instance 7c80add9-d970-4aae-9ab5-6df59903b074 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:17:59.127996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7c0297f3-b35e-4475-9dd3-1dc4e162c11f tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "DELETE /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 404 len: 111 microversion: 2.20 time: 0.028115 Jan 31 17:17:59.127996 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 690/1291] 10.222.0.91 () {60 vars in 1279 bytes} [Mon Jan 31 17:17:59 2022] DELETE /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:17:59.136445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:17:59.137068 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] [instance: 7c80add9-d970-4aae-9ab5-6df59903b074] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:17:59.143498 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:59.143961 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:59.144788 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:17:59.145235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:17:59.159845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] HTTP exception thrown: Instance 7c80add9-d970-4aae-9ab5-6df59903b074 could not be found. Jan 31 17:17:59.160477 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] Returning 404 to user: Instance 7c80add9-d970-4aae-9ab5-6df59903b074 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:17:59.161329 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-770052e9-0989-401e-92af-a66bbcbcde4e tempest-AttachVolumeShelveTestJSON-1982659492 tempest-AttachVolumeShelveTestJSON-1982659492-project] 10.222.0.91 "GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074" status: 404 len: 111 microversion: 2.20 time: 0.028895 Jan 31 17:17:59.161950 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 602/1292] 10.222.0.91 () {60 vars in 1276 bytes} [Mon Jan 31 17:17:59 2022] GET /compute/v2.1/servers/7c80add9-d970-4aae-9ab5-6df59903b074 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 31 17:19:10.532481 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:19:10.533119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:19:26.155276 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:26.155986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:26.162176 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:26.162629 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:26.163414 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:26.163852 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:26.190405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Going to try to terminate instance {{(pid=116483) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:19:26.265873 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7debe7b8-9fad-477d-8af6-8b827621c83c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "DELETE /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 204 len: 0 microversion: 2.1 time: 0.114870 Jan 31 17:19:26.266500 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 691/1293] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:19:26 2022] DELETE /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:19:26.276667 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:26.277488 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:26.283782 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:26.284272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:26.285063 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:26.285535 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:26.427604 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:26.435068 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9924bf31-bc16-4109-a5cd-62b7dc9ce91e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1578 microversion: 2.1 time: 0.163270 Jan 31 17:19:26.435632 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 603/1294] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:26 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:27.454267 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:27.455510 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:27.461987 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:27.462453 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:27.463246 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:27.463696 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:27.628983 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:27.636809 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7719a8e4-e3bd-4a49-b1ec-c8208010cb25 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1578 microversion: 2.1 time: 0.186708 Jan 31 17:19:27.637379 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 692/1295] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:27 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:28.654652 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:28.655299 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:28.662781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:28.663242 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:28.664076 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:28.664548 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:28.808292 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:28.816130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-33281706-1d00-4a9d-aa6e-afe2be05cb1c tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1578 microversion: 2.1 time: 0.165223 Jan 31 17:19:28.816708 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 604/1296] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:28 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:29.409118 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-a288175b-1e8f-4df0-9a5b-e2ddf29ebc13 req-d41794d4-bc66-4d62-a500-f170e60dea81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa5ce45-657d-4aa3-aa1a-130457329fb7", "name": "network-vif-deleted", "tag": "b3738a13-04f7-44a8-ac50-ef54498f598e"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:19:29.410713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:19:29.410713 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:19:29.417716 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a288175b-1e8f-4df0-9a5b-e2ddf29ebc13 req-d41794d4-bc66-4d62-a500-f170e60dea81 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:29.418290 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a288175b-1e8f-4df0-9a5b-e2ddf29ebc13 req-d41794d4-bc66-4d62-a500-f170e60dea81 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:29.430188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-a288175b-1e8f-4df0-9a5b-e2ddf29ebc13 req-d41794d4-bc66-4d62-a500-f170e60dea81 service nova] Creating event network-vif-deleted:b3738a13-04f7-44a8-ac50-ef54498f598e for instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 on hv-cinder-81566 Jan 31 17:19:29.435317 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-a288175b-1e8f-4df0-9a5b-e2ddf29ebc13 req-d41794d4-bc66-4d62-a500-f170e60dea81 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030197 Jan 31 17:19:29.436347 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 693/1297] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:19:29.834786 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:29.835617 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:29.842937 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:29.843401 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:29.844282 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:29.844728 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:29.880340 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:29.881127 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:29.881725 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.objects.instance [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lazy-loading 'fault' on Instance uuid cfa5ce45-657d-4aa3-aa1a-130457329fb7 {{(pid=116482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 31 17:19:29.924179 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:29.936987 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ae970513-c4a5-4b9c-878d-02b314deb17d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 200 len: 1231 microversion: 2.1 time: 0.105924 Jan 31 17:19:29.937586 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 605/1298] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:29 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:30.955587 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:30.956426 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:30.962808 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:30.963261 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:30.964068 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:30.964533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:30.978761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] HTTP exception thrown: Instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 could not be found. Jan 31 17:19:30.979368 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Returning 404 to user: Instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:19:30.980252 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fb2b0231-11f7-489c-89b5-9a5ed7f161c2 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 404 len: 111 microversion: 2.1 time: 0.029280 Jan 31 17:19:30.980807 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 694/1299] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:30 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:19:31.083285 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1444775675", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1962695943", "security_groups": [{"name": "tempest-secgroup-smoke-187526338"}], "block_device_mapping_v2": [{"uuid": "24672cb6-a00f-49d3-955b-380f72c79f3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3410a9f-2a7c-45fe-a775-4b87760d2a32"}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:19:31.204634 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] validate_networks() for [('c3410a9f-2a7c-45fe-a775-4b87760d2a32', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:19:31.625213 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:19:31.625637 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:19:31.626114 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:19:31.626530 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:19:31.627534 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:19:31.636887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:31.637341 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:31.638215 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:31.638655 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:31.656892 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for project 0070c6d36b294fcd87adac6ded40165c. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:19:31.661731 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for user e2b3b1f45d1b4b4995bad98ce0236b07 and project 0070c6d36b294fcd87adac6ded40165c. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:19:31.724884 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:19:31.727022 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24672cb6-a00f-49d3-955b-380f72c79f3f',volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:19:31.866813 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1381d671-89e3-4bbf-a723-0a307a76bda9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785997 Jan 31 17:19:31.869759 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 606/1300] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:19:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:19:31.885029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-ca8b4c41-487c-427d-9adb-a916b85c7980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:31.886062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-ca8b4c41-487c-427d-9adb-a916b85c7980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:31.956436 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-ca8b4c41-487c-427d-9adb-a916b85c7980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:31.963870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-ca8b4c41-487c-427d-9adb-a916b85c7980 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1095 microversion: 2.1 time: 0.085898 Jan 31 17:19:31.964480 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 695/1301] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:31 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:32.982232 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:32.982933 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:32.990297 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:32.990793 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:32.991642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:32.992323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:33.071542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:33.089658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-995fe01e-f6b7-444b-bee4-1a8967b2795f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1193 microversion: 2.1 time: 0.111790 Jan 31 17:19:33.090323 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 607/1302] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:32 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:34.117532 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:34.118756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:34.128670 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:34.129479 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:34.130350 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:34.130797 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:34.409488 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:34.421610 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-68925947-9929-46cf-82ce-254ae915393d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1278 microversion: 2.1 time: 0.310114 Jan 31 17:19:34.422602 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 696/1303] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:34 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1278 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:34.989217 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-fa499567-ce38-40e2-a85d-d3c0d7b75739 req-18e84ebc-3f0c-497f-80b1-fe5223c0c1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731207a9-dbca-4df7-804b-b7f9d30414e6", "tag": "d563d893-8b12-4871-94ad-69630058f0ba"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:19:35.000085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:19:35.000085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:19:35.023951 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-fa499567-ce38-40e2-a85d-d3c0d7b75739 req-18e84ebc-3f0c-497f-80b1-fe5223c0c1be service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:35.024857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-fa499567-ce38-40e2-a85d-d3c0d7b75739 req-18e84ebc-3f0c-497f-80b1-fe5223c0c1be service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:35.051248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-fa499567-ce38-40e2-a85d-d3c0d7b75739 req-18e84ebc-3f0c-497f-80b1-fe5223c0c1be service nova] Creating event network-changed:d563d893-8b12-4871-94ad-69630058f0ba for instance 731207a9-dbca-4df7-804b-b7f9d30414e6 on hv-cinder-81566 Jan 31 17:19:35.060582 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-fa499567-ce38-40e2-a85d-d3c0d7b75739 req-18e84ebc-3f0c-497f-80b1-fe5223c0c1be service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079113 Jan 31 17:19:35.062103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 608/1304] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:19:35.446329 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:35.446928 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:35.453765 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:35.454226 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:35.455075 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:35.455521 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:35.603335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:35.613322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-a3d7603a-a764-484b-b034-77bb83f81fd1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.170588 Jan 31 17:19:35.613910 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 697/1305] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:35 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:36.647429 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:36.648278 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:36.654595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:36.655048 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:36.655955 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:36.656427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:36.837174 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:36.844820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b31c11ea-40b5-495f-a2b4-f72d3ece3ad0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.204915 Jan 31 17:19:36.845400 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 609/1306] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:36 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:37.864299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:37.864963 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:37.871543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:37.871997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:37.872814 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:37.873259 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:38.021880 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:38.029695 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-09c388ca-9870-4a0b-97ff-5fdfa7c79ce3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.170140 Jan 31 17:19:38.030287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 698/1307] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:37 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:39.050774 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:39.051711 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:39.060606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:39.061254 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:39.062332 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:39.062875 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:39.250140 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:39.257865 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-ad6aae2e-ad96-47fe-b7cf-14d888c315b6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.213076 Jan 31 17:19:39.259386 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 610/1308] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:39 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:40.278956 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:40.279603 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:40.286407 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:40.286874 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:40.287667 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:40.288145 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:40.436439 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:40.445384 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-57d95db2-ca94-4933-83b6-23fec13aba7a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.170033 Jan 31 17:19:40.445972 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 699/1309] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:40 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:41.462142 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:41.462763 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:41.469146 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:41.469599 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:41.470386 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:41.471120 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:41.609640 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:41.618072 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b148d4c9-b512-4850-b178-40e123549312 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.159560 Jan 31 17:19:41.618636 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 611/1310] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:41 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:42.635986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:42.637723 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:42.643783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:42.644280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:42.645069 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:42.645503 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:42.832211 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:42.842391 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-8a917be3-93cb-4407-9aa6-4212b91a31dc tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.209972 Jan 31 17:19:42.842970 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 700/1311] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:42 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:43.860828 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:43.861519 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:43.868190 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:43.868653 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:43.869448 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:43.869897 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:44.021403 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:44.029649 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4f065bbb-709e-4b56-be7d-353e7f7378b1 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.172551 Jan 31 17:19:44.030215 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 612/1312] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:43 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:45.048193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:45.049837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:45.057792 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:45.058359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:45.059185 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:45.059682 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:45.200759 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:45.209995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-dc2c3b97-88ca-4348-b68e-bf3225ddd0ed tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.165531 Jan 31 17:19:45.210641 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 701/1313] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:45 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:45.821551 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-6272f9d8-c087-4f62-9442-e57486a7e763 req-7c3d3b8a-857c-42c9-a7e2-505940fb1332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731207a9-dbca-4df7-804b-b7f9d30414e6", "name": "network-vif-plugged", "status": "completed", "tag": "d563d893-8b12-4871-94ad-69630058f0ba"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:19:45.821551 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:19:45.821551 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:19:45.829570 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-6272f9d8-c087-4f62-9442-e57486a7e763 req-7c3d3b8a-857c-42c9-a7e2-505940fb1332 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:45.830683 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-6272f9d8-c087-4f62-9442-e57486a7e763 req-7c3d3b8a-857c-42c9-a7e2-505940fb1332 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:45.842108 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-6272f9d8-c087-4f62-9442-e57486a7e763 req-7c3d3b8a-857c-42c9-a7e2-505940fb1332 service nova] Creating event network-vif-plugged:d563d893-8b12-4871-94ad-69630058f0ba for instance 731207a9-dbca-4df7-804b-b7f9d30414e6 on hv-cinder-81566 Jan 31 17:19:45.848578 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-6272f9d8-c087-4f62-9442-e57486a7e763 req-7c3d3b8a-857c-42c9-a7e2-505940fb1332 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247588 Jan 31 17:19:45.849112 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 613/1314] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:19:46.228056 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:46.228705 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:46.235525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:46.236576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:46.238179 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:46.238620 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:46.392783 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:46.402741 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-4a630d86-6897-494b-b9fe-738a563492c6 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.178805 Jan 31 17:19:46.403418 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 702/1315] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:46 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:47.423731 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:47.425007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:47.435913 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:47.436475 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:47.437339 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:47.437851 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:47.619818 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:47.628381 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-11f1f2a5-3fce-4ceb-9e3f-ad41786a4f49 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1266 microversion: 2.1 time: 0.209947 Jan 31 17:19:47.628966 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 614/1316] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:47 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:48.645777 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:48.646336 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:48.654462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:48.655137 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:48.656322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:48.656322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:48.827997 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:48.836315 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-1cad3987-cd77-47d0-a7f3-3a10e580c9cb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1453 microversion: 2.1 time: 0.194413 Jan 31 17:19:48.837106 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 703/1317] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:48 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:19:48.854985 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:19:48.855642 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:19:48.864269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:48.864740 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:48.865522 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:48.866085 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:49.025562 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:19:49.033803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0ef40559-1ca8-40c5-b382-a82b857e4bbb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1453 microversion: 2.1 time: 0.182411 Jan 31 17:19:49.034388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 615/1318] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:19:48 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:19:51.379321 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-f7d281de-c72a-42f3-89a8-c3f2b9e24eae req-28ba0c1d-659f-4580-8b1a-73e053e53145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731207a9-dbca-4df7-804b-b7f9d30414e6", "tag": "d563d893-8b12-4871-94ad-69630058f0ba"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:19:51.381888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:19:51.381888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:19:51.403297 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f7d281de-c72a-42f3-89a8-c3f2b9e24eae req-28ba0c1d-659f-4580-8b1a-73e053e53145 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:19:51.403708 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f7d281de-c72a-42f3-89a8-c3f2b9e24eae req-28ba0c1d-659f-4580-8b1a-73e053e53145 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:19:51.421939 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-f7d281de-c72a-42f3-89a8-c3f2b9e24eae req-28ba0c1d-659f-4580-8b1a-73e053e53145 service nova] Creating event network-changed:d563d893-8b12-4871-94ad-69630058f0ba for instance 731207a9-dbca-4df7-804b-b7f9d30414e6 on hv-cinder-81566 Jan 31 17:19:51.433258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-f7d281de-c72a-42f3-89a8-c3f2b9e24eae req-28ba0c1d-659f-4580-8b1a-73e053e53145 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064917 Jan 31 17:19:51.434324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 704/1319] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:20:48.430577 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:20:48.431447 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: Mon Jan 31 17:20:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:21:38.857297 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-876375590", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1962695943", "security_groups": [{"name": "tempest-secgroup-smoke-187526338"}], "block_device_mapping_v2": [{"uuid": "7b75af05-9d68-4e85-b248-ab1506a1a4a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3410a9f-2a7c-45fe-a775-4b87760d2a32"}]}} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:21:38.970090 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.network.neutron [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] validate_networks() for [('c3410a9f-2a7c-45fe-a775-4b87760d2a32', None, None, None, None, None)] {{(pid=116482) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 31 17:21:39.491294 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Flavor limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 31 17:21:39.491720 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Image limits 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 31 17:21:39.492228 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Flavor pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 31 17:21:39.492639 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Image pref 0:0:0 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 31 17:21:39.493049 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.virt.hardware [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 31 17:21:39.501974 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:39.502422 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:39.503260 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:39.503700 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:39.520137 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for project 0070c6d36b294fcd87adac6ded40165c. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 31 17:21:39.523982 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.quota [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Getting quotas for user e2b3b1f45d1b4b4995bad98ce0236b07 and project 0070c6d36b294fcd87adac6ded40165c. Resources: {'cores', 'instances', 'ram'} {{(pid=116482) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 31 17:21:39.584269 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Going to run 1 instances... {{(pid=116482) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 31 17:21:39.586427 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b75af05-9d68-4e85-b248-ab1506a1a4a0',volume_size=None,volume_type=None)] {{(pid=116482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 31 17:21:39.721360 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-97aa59e2-d1e9-4402-9b93-36d8b9657839 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.868968 Jan 31 17:21:39.722017 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 616/1320] 10.222.0.91 () {60 vars in 1146 bytes} [Mon Jan 31 17:21:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 31 17:21:39.738885 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-92d8418b-8f50-4bae-95a4-5a37dcc0fd09 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:39.739530 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-92d8418b-8f50-4bae-95a4-5a37dcc0fd09 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:39.805343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-92d8418b-8f50-4bae-95a4-5a37dcc0fd09 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:39.811909 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-92d8418b-8f50-4bae-95a4-5a37dcc0fd09 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1094 microversion: 2.1 time: 0.079761 Jan 31 17:21:39.812680 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 705/1321] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:39 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:40.829993 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-f966cb1c-eba8-4c7a-98f6-ad8fed7115b7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:40.830626 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-f966cb1c-eba8-4c7a-98f6-ad8fed7115b7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:40.883882 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-f966cb1c-eba8-4c7a-98f6-ad8fed7115b7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:40.890876 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-f966cb1c-eba8-4c7a-98f6-ad8fed7115b7 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1094 microversion: 2.1 time: 0.065056 Jan 31 17:21:40.891511 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 617/1322] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:40 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:41.908405 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-2809c79c-d3c5-4d70-92a4-34eef608339e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:41.909034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-2809c79c-d3c5-4d70-92a4-34eef608339e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:41.966005 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-2809c79c-d3c5-4d70-92a4-34eef608339e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:41.973870 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-2809c79c-d3c5-4d70-92a4-34eef608339e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1094 microversion: 2.1 time: 0.069674 Jan 31 17:21:41.974459 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 706/1323] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:41 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:42.991162 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-5b3bb2ad-7bc7-4648-b6d6-f710af13bd83 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:42.991794 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-5b3bb2ad-7bc7-4648-b6d6-f710af13bd83 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:43.061591 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-5b3bb2ad-7bc7-4648-b6d6-f710af13bd83 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:43.072735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-5b3bb2ad-7bc7-4648-b6d6-f710af13bd83 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1094 microversion: 2.1 time: 0.085061 Jan 31 17:21:43.073335 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 618/1324] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:42 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:44.090151 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:44.090769 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:44.098060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:44.098664 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:44.099311 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:44.100014 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:44.163888 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:44.171299 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-d648d311-2609-42a3-8b72-c9e49da6d4bb tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1144 microversion: 2.1 time: 0.084863 Jan 31 17:21:44.171905 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 707/1325] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:44 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:45.190223 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:45.190781 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:45.198001 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:45.198456 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:45.199249 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:45.199685 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:45.265405 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:45.273676 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-51b19334-7976-448e-807a-2b4c589fa92f tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1210 microversion: 2.1 time: 0.088527 Jan 31 17:21:45.274256 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 619/1326] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:45 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:46.292346 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:46.293000 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:46.300702 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:46.301117 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:46.302017 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:46.302476 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:46.358186 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-c1a22d8a-f782-4c16-8c84-9e2d96883040 req-aa8206d2-90ed-4d17-a335-8fb38ecfe914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d650174-8e0a-42a1-8542-86a9e192673c", "tag": "ed8f8410-ba93-45fd-879f-8b0c93d12792"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:21:46.363255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:21:46.363255 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:21:46.397991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-c1a22d8a-f782-4c16-8c84-9e2d96883040 req-aa8206d2-90ed-4d17-a335-8fb38ecfe914 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:46.398532 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-c1a22d8a-f782-4c16-8c84-9e2d96883040 req-aa8206d2-90ed-4d17-a335-8fb38ecfe914 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:46.412718 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-c1a22d8a-f782-4c16-8c84-9e2d96883040 req-aa8206d2-90ed-4d17-a335-8fb38ecfe914 service nova] Creating event network-changed:ed8f8410-ba93-45fd-879f-8b0c93d12792 for instance 6d650174-8e0a-42a1-8542-86a9e192673c on hv-cinder-81566 Jan 31 17:21:46.418606 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-c1a22d8a-f782-4c16-8c84-9e2d96883040 req-aa8206d2-90ed-4d17-a335-8fb38ecfe914 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064407 Jan 31 17:21:46.420388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 620/1327] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:21:46.518302 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:46.526392 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-fb5355e1-108b-4f78-bca9-ca966f483cab tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.237771 Jan 31 17:21:46.527668 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 708/1328] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:46 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:47.545433 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:47.546143 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:47.552987 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:47.553445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:47.554250 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:47.554698 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:47.706775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:47.714674 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-bfaf1202-6a5e-4fb4-942c-a3985dd4ae87 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.173656 Jan 31 17:21:47.715272 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 621/1329] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:47 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:48.733316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:48.733941 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:48.740622 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:48.741083 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:48.741873 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:48.742316 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:48.897746 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:48.907322 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-5f133aa1-426a-43c5-b06d-0ab4154dd9a3 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.178417 Jan 31 17:21:48.907933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 709/1330] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:48 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:49.928658 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:49.929262 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:49.935820 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:49.936307 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:49.937086 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:49.938297 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:50.074754 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:50.082898 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-93698ed7-e52b-45ab-96dc-a197cd7338db tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.157872 Jan 31 17:21:50.083467 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 622/1331] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:49 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:51.099576 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:51.100208 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:51.106495 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:51.106943 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:51.107724 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:51.108180 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:51.246323 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:51.254324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-cf4a594d-ae6c-4dbe-bb8e-f1f4a378a209 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.158405 Jan 31 17:21:51.254929 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 710/1332] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:51 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:52.271919 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:52.272631 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:52.278784 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:52.279235 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:52.280011 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:52.280476 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:52.423135 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:52.430529 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-1b3c58a3-c0ce-4cdc-9da2-9619a9d36abd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.162322 Jan 31 17:21:52.431103 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 623/1333] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:52 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:53.450023 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:53.451094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:53.462586 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:53.463328 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:53.464650 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:53.465387 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:53.613038 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:53.620260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-0c63813f-494d-4927-823e-d3140b401e2b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.176111 Jan 31 17:21:53.620827 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 711/1334] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:53 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:54.636854 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:54.637495 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:54.644542 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:54.645001 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:54.645795 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:54.646242 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:54.788268 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:54.795635 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-d2311e01-92e2-4f83-b4d1-bead1e44baf4 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.162421 Jan 31 17:21:54.796205 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 624/1335] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:54 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:55.813335 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:55.814031 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:55.820343 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:55.820831 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:55.821621 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:55.822062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:55.956919 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:55.964234 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-e8e77a0c-5e3b-461e-96cd-441288861245 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.155286 Jan 31 17:21:55.964800 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 712/1336] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:55 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:56.388775 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-ccb48d31-5f2f-4ab3-ba3a-7c65823006d9 req-eac5f953-203f-410c-b068-0568709521c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d650174-8e0a-42a1-8542-86a9e192673c", "name": "network-vif-plugged", "status": "completed", "tag": "ed8f8410-ba93-45fd-879f-8b0c93d12792"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:21:56.390533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:21:56.390533 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:21:56.398388 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ccb48d31-5f2f-4ab3-ba3a-7c65823006d9 req-eac5f953-203f-410c-b068-0568709521c6 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:56.398887 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-ccb48d31-5f2f-4ab3-ba3a-7c65823006d9 req-eac5f953-203f-410c-b068-0568709521c6 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:56.410342 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-ccb48d31-5f2f-4ab3-ba3a-7c65823006d9 req-eac5f953-203f-410c-b068-0568709521c6 service nova] Creating event network-vif-plugged:ed8f8410-ba93-45fd-879f-8b0c93d12792 for instance 6d650174-8e0a-42a1-8542-86a9e192673c on hv-cinder-81566 Jan 31 17:21:56.415248 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-ccb48d31-5f2f-4ab3-ba3a-7c65823006d9 req-eac5f953-203f-410c-b068-0568709521c6 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030131 Jan 31 17:21:56.416130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 625/1337] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:21:56.982119 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:56.982694 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:56.989798 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:56.990260 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:56.991066 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:56.991509 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:57.131029 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:57.138287 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-611a1236-f3ca-4936-b52c-b2e1ea6912be tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.159962 Jan 31 17:21:57.138849 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 713/1338] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:56 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:58.157177 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:58.157821 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:58.163991 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:58.164490 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:58.165289 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:58.165735 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:58.306212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:58.315439 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-3a3948aa-3fa9-4a08-909b-d2cb8333624b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1265 microversion: 2.1 time: 0.163599 Jan 31 17:21:58.316027 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 626/1339] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:58 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:59.333084 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:59.333715 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:59.339598 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:59.340050 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:59.341139 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:59.341359 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:59.479756 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:59.488371 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-f3a4ccd7-4419-4347-993a-ca4abd535603 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1452 microversion: 2.1 time: 0.159141 Jan 31 17:21:59.488964 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 714/1340] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:59 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:21:59.504451 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:21:59.505071 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:21:59.511345 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:59.511799 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:59.512625 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:21:59.513070 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:21:59.667469 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:21:59.674994 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-115c23df-47c6-4f5d-8e1a-16aa3284efca tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1452 microversion: 2.1 time: 0.174198 Jan 31 17:21:59.675564 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 627/1341] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:21:59 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:22:01.365004 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-9260a910-b875-4d54-ad11-4d7cb5f5144d req-fbef77a9-b9e9-4034-a133-0e823e792a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d650174-8e0a-42a1-8542-86a9e192673c", "tag": "ed8f8410-ba93-45fd-879f-8b0c93d12792"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:22:01.366525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:22:01.366525 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:22:01.374124 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-9260a910-b875-4d54-ad11-4d7cb5f5144d req-fbef77a9-b9e9-4034-a133-0e823e792a7f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:22:01.374658 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-9260a910-b875-4d54-ad11-4d7cb5f5144d req-fbef77a9-b9e9-4034-a133-0e823e792a7f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:22:01.386596 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-9260a910-b875-4d54-ad11-4d7cb5f5144d req-fbef77a9-b9e9-4034-a133-0e823e792a7f service nova] Creating event network-changed:ed8f8410-ba93-45fd-879f-8b0c93d12792 for instance 6d650174-8e0a-42a1-8542-86a9e192673c on hv-cinder-81566 Jan 31 17:22:01.392533 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-9260a910-b875-4d54-ad11-4d7cb5f5144d req-fbef77a9-b9e9-4034-a133-0e823e792a7f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030976 Jan 31 17:22:01.393150 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 715/1342] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:22:10.549803 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:22:10.550547 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:22:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:22:30.543041 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:22:30.543806 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:23:47.135320 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:47.136614 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:47.143796 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:47.144362 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:47.145264 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:47.146221 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:47.173130 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:23:47.242933 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-f9888a08-c385-48f4-8c7f-25c417239ab6 req-01787a99-4c1b-4b08-a7b6-d3b0fbc06070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d650174-8e0a-42a1-8542-86a9e192673c", "tag": "ed8f8410-ba93-45fd-879f-8b0c93d12792"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:23:47.244731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:23:47.244731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:23:47.255695 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f9888a08-c385-48f4-8c7f-25c417239ab6 req-01787a99-4c1b-4b08-a7b6-d3b0fbc06070 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:47.256592 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f9888a08-c385-48f4-8c7f-25c417239ab6 req-01787a99-4c1b-4b08-a7b6-d3b0fbc06070 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:47.269230 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-b5b04d53-37bf-48ab-be39-c2775d5171de tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "DELETE /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 204 len: 0 microversion: 2.1 time: 0.138274 Jan 31 17:23:47.269838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 628/1343] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:23:47 2022] DELETE /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:23:47.275070 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-f9888a08-c385-48f4-8c7f-25c417239ab6 req-01787a99-4c1b-4b08-a7b6-d3b0fbc06070 service nova] Creating event network-changed:ed8f8410-ba93-45fd-879f-8b0c93d12792 for instance 6d650174-8e0a-42a1-8542-86a9e192673c on hv-cinder-81566 Jan 31 17:23:47.280295 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:47.281073 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-f9888a08-c385-48f4-8c7f-25c417239ab6 req-01787a99-4c1b-4b08-a7b6-d3b0fbc06070 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147826 Jan 31 17:23:47.281354 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:47.282036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 716/1344] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:23:47.288139 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:47.288597 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:47.289413 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:47.289861 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:47.494859 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:23:47.502857 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-0559bd54-05c6-4250-b472-f10fa9349e2e tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1577 microversion: 2.1 time: 0.228105 Jan 31 17:23:47.503841 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 629/1345] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:47 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 31 17:23:48.526345 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:48.527036 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:48.533280 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:48.533735 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:48.534512 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:48.534950 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:48.730577 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:23:48.740062 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-45cc1b4e-393e-4789-b611-592bedca327a tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1458 microversion: 2.1 time: 0.218152 Jan 31 17:23:48.740857 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 717/1346] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:48 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1458 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:23:49.757980 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:49.758831 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:49.759385 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-a7d71d8f-46ce-40e3-838f-2611c7bf7279 req-05bdd7dd-8304-4190-8423-a4b904e52642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d650174-8e0a-42a1-8542-86a9e192673c", "name": "network-vif-deleted", "tag": "ed8f8410-ba93-45fd-879f-8b0c93d12792"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:23:49.760967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:23:49.760967 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:23:49.766465 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:49.766906 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:49.767705 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:49.768402 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:49.771611 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a7d71d8f-46ce-40e3-838f-2611c7bf7279 req-05bdd7dd-8304-4190-8423-a4b904e52642 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:49.772094 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-a7d71d8f-46ce-40e3-838f-2611c7bf7279 req-05bdd7dd-8304-4190-8423-a4b904e52642 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:49.785342 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-a7d71d8f-46ce-40e3-838f-2611c7bf7279 req-05bdd7dd-8304-4190-8423-a4b904e52642 service nova] Creating event network-vif-deleted:ed8f8410-ba93-45fd-879f-8b0c93d12792 for instance 6d650174-8e0a-42a1-8542-86a9e192673c on hv-cinder-81566 Jan 31 17:23:49.790409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-a7d71d8f-46ce-40e3-838f-2611c7bf7279 req-05bdd7dd-8304-4190-8423-a4b904e52642 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034677 Jan 31 17:23:49.791238 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 718/1347] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:23:49.832279 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:23:49.840013 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-93b19924-8915-4c97-8972-22b4f6bd6aa9 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 200 len: 1391 microversion: 2.1 time: 0.085706 Jan 31 17:23:49.840732 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 630/1348] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:49 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:23:50.859133 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:50.860495 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 6d650174-8e0a-42a1-8542-86a9e192673c] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:50.870295 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:50.870731 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:50.871613 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:50.872053 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:50.886324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] HTTP exception thrown: Instance 6d650174-8e0a-42a1-8542-86a9e192673c could not be found. Jan 31 17:23:50.886926 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Returning 404 to user: Instance 6d650174-8e0a-42a1-8542-86a9e192673c could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:23:50.887763 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-32b9ae82-de53-4264-8339-10ee5e132568 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c" status: 404 len: 111 microversion: 2.1 time: 0.033583 Jan 31 17:23:50.889541 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 719/1349] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:50 2022] GET /compute/v2.1/servers/6d650174-8e0a-42a1-8542-86a9e192673c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:23:53.984011 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:53.984603 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:53.987227 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [req-f1ce7d06-851f-4627-b97d-7927ae13f4e8 req-36240977-a87a-462e-9890-3d9889793e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731207a9-dbca-4df7-804b-b7f9d30414e6", "tag": "d563d893-8b12-4871-94ad-69630058f0ba"}]} {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:23:53.989034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:23:53.989034 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: warnings.warn(msg) Jan 31 17:23:53.991458 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:53.991914 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:53.992746 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:53.993183 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:53.997758 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f1ce7d06-851f-4627-b97d-7927ae13f4e8 req-36240977-a87a-462e-9890-3d9889793e3f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:53.998353 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [req-f1ce7d06-851f-4627-b97d-7927ae13f4e8 req-36240977-a87a-462e-9890-3d9889793e3f service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:54.010230 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.compute.server_external_events [req-f1ce7d06-851f-4627-b97d-7927ae13f4e8 req-36240977-a87a-462e-9890-3d9889793e3f service nova] Creating event network-changed:d563d893-8b12-4871-94ad-69630058f0ba for instance 731207a9-dbca-4df7-804b-b7f9d30414e6 on hv-cinder-81566 Jan 31 17:23:54.016882 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [req-f1ce7d06-851f-4627-b97d-7927ae13f4e8 req-36240977-a87a-462e-9890-3d9889793e3f service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035177 Jan 31 17:23:54.017924 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 720/1350] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 31 17:23:54.021155 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Going to try to terminate instance {{(pid=116482) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 31 17:23:54.117175 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-4a67d066-389d-4975-9d8b-ab8dace2196d tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "DELETE /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 204 len: 0 microversion: 2.1 time: 0.138012 Jan 31 17:23:54.118182 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 631/1351] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:23:53 2022] DELETE /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 31 17:23:54.130102 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:54.131409 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:54.142959 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:54.143787 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:54.145258 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:54.146090 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:54.327105 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:23:54.335060 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-61f7409c-68d5-4957-9162-abf5ccb7f6fd tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1578 microversion: 2.1 time: 0.212142 Jan 31 17:23:54.336250 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 721/1352] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:54 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:23:55.358803 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:55.359505 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:55.366129 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:55.366580 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:55.367363 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:55.367838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:55.506912 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.policy [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116482) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:23:55.514770 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-9b68e7f1-de49-4013-a330-082ee90d0db0 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1459 microversion: 2.1 time: 0.160880 Jan 31 17:23:55.515356 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 632/1353] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:55 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1459 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:23:56.531462 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:56.532192 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:56.538543 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:56.538995 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:56.539781 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:56.540245 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:56.679171 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.policy [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2b3b1f45d1b4b4995bad98ce0236b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0070c6d36b294fcd87adac6ded40165c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116483) authorize /opt/stack/nova/nova/policy.py:199}} Jan 31 17:23:56.690837 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-65861cac-f400-48f4-858a-5b800851fa3b tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 200 len: 1459 microversion: 2.1 time: 0.163126 Jan 31 17:23:56.700477 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 722/1354] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:56 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 31 17:23:56.748393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [req-7f073bed-f40c-4488-bf22-f8758ece4525 req-bc4b713c-061d-45f9-bd4b-9d81dfa00343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731207a9-dbca-4df7-804b-b7f9d30414e6", "name": "network-vif-deleted", "tag": "d563d893-8b12-4871-94ad-69630058f0ba"}]} {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 31 17:23:56.750197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 31 17:23:56.750197 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: warnings.warn(msg) Jan 31 17:23:56.759471 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-7f073bed-f40c-4488-bf22-f8758ece4525 req-bc4b713c-061d-45f9-bd4b-9d81dfa00343 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:56.759920 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [req-7f073bed-f40c-4488-bf22-f8758ece4525 req-bc4b713c-061d-45f9-bd4b-9d81dfa00343 service nova] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:56.772375 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.compute.server_external_events [req-7f073bed-f40c-4488-bf22-f8758ece4525 req-bc4b713c-061d-45f9-bd4b-9d81dfa00343 service nova] Creating event network-vif-deleted:d563d893-8b12-4871-94ad-69630058f0ba for instance 731207a9-dbca-4df7-804b-b7f9d30414e6 on hv-cinder-81566 Jan 31 17:23:56.777694 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [req-7f073bed-f40c-4488-bf22-f8758ece4525 req-bc4b713c-061d-45f9-bd4b-9d81dfa00343 service nova] 10.222.0.91 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033386 Jan 31 17:23:56.778328 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 633/1355] 10.222.0.91 () {64 vars in 1317 bytes} [Mon Jan 31 17:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 31 17:23:57.707771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:57.708422 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: 731207a9-dbca-4df7-804b-b7f9d30414e6] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:57.714738 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:57.715188 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:57.716006 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:57.716676 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:57.731043 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] HTTP exception thrown: Instance 731207a9-dbca-4df7-804b-b7f9d30414e6 could not be found. Jan 31 17:23:57.731669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Returning 404 to user: Instance 731207a9-dbca-4df7-804b-b7f9d30414e6 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:23:57.732891 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-9b5a3922-e4ba-42ec-8754-9dc64c3aef54 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6" status: 404 len: 111 microversion: 2.1 time: 0.028571 Jan 31 17:23:57.733518 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 723/1356] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:57 2022] GET /compute/v2.1/servers/731207a9-dbca-4df7-804b-b7f9d30414e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:23:58.213391 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:58.214007 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.compute.api [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116482) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:58.221212 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:58.221595 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:58.222393 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:58.222845 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG oslo_concurrency.lockutils [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:58.239529 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.wsgi [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] HTTP exception thrown: Instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 could not be found. Jan 31 17:23:58.240169 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Returning 404 to user: Instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 could not be found. {{(pid=116482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:23:58.241016 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-436b1c8d-91d9-4500-8b28-b111a7cfb366 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "DELETE /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 404 len: 111 microversion: 2.1 time: 0.032394 Jan 31 17:23:58.241589 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 634/1357] 10.222.0.91 () {58 vars in 1238 bytes} [Mon Jan 31 17:23:58 2022] DELETE /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:23:58.250755 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '>' {{(pid=116483) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:58.251373 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.compute.api [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [instance: cfa5ce45-657d-4aa3-aa1a-130457329fb7] Fetching instance by UUID {{(pid=116483) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 31 17:23:58.257300 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:58.257761 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:58.258554 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 31 17:23:58.259030 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG oslo_concurrency.lockutils [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Lock "bd739326-28c2-4c93-a99b-2c85f99964f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116483) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 31 17:23:58.272306 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.wsgi [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] HTTP exception thrown: Instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 could not be found. Jan 31 17:23:58.272912 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: DEBUG nova.api.openstack.wsgi [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Returning 404 to user: Instance cfa5ce45-657d-4aa3-aa1a-130457329fb7 could not be found. {{(pid=116483) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 31 17:23:58.273782 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO nova.api.openstack.requestlog [None req-7763c905-d3cb-4676-bbb2-c0106cd03ad5 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7" status: 404 len: 111 microversion: 2.1 time: 0.027745 Jan 31 17:23:58.274324 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: [pid: 116483|app: 0|req: 724/1358] 10.222.0.91 () {58 vars in 1235 bytes} [Mon Jan 31 17:23:58 2022] GET /compute/v2.1/servers/cfa5ce45-657d-4aa3-aa1a-130457329fb7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 31 17:23:59.566445 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: DEBUG nova.api.openstack.wsgi [None req-029cd10e-3ac1-44ae-ab65-8db72d184895 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] Calling method '.version_select at 0x7fdce2977790>' {{(pid=116482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 31 17:23:59.569649 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: ERROR oslo.messaging._drivers.impl_rabbit [None req-029cd10e-3ac1-44ae-ab65-8db72d184895 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [c21407c8-2e26-4f09-b422-bea9f0f31ebc] AMQP server on 10.222.0.91:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 31 17:24:00.578006 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [None req-029cd10e-3ac1-44ae-ab65-8db72d184895 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] [c21407c8-2e26-4f09-b422-bea9f0f31ebc] Reconnected to AMQP server on 10.222.0.91:5672 via [amqp] client with port 48254. Jan 31 17:24:00.596890 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO nova.api.openstack.requestlog [None req-029cd10e-3ac1-44ae-ab65-8db72d184895 tempest-TestVolumeBootPattern-1479402579 tempest-TestVolumeBootPattern-1479402579-project] 10.222.0.91 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1962695943" status: 202 len: 0 microversion: 2.1 time: 1.034005 Jan 31 17:24:00.597479 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: [pid: 116482|app: 0|req: 635/1359] 10.222.0.91 () {58 vars in 1262 bytes} [Mon Jan 31 17:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1962695943 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 31 17:25:30.558153 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:25:30.558771 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:25:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:25:50.552986 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:25:50.553669 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:27:11.132858 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:27:11.134412 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: Mon Jan 31 17:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:28:50.566193 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:28:50.566719 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:29:08.445220 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:29:08.445838 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: Mon Jan 31 17:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:29:10.561475 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:29:10.561960 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:29:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:29:11.511015 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:29:11.511239 dv-cinder-815660-5-iscsi devstack@n-api.service[116483]: Mon Jan 31 17:29:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 31 17:29:12.311641 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 31 17:29:12.312466 dv-cinder-815660-5-iscsi devstack@n-api.service[116482]: Mon Jan 31 17:29:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!